Move integration tests to minimal examples folder · jsess79/speechbrain@6b08443 · GitHub
Skip to content

Commit 6b08443

Browse files
pplantingapplantinga
committed
Move integration tests to minimal examples folder
1 parent c425a78 commit 6b08443

11 files changed

Lines changed: 22 additions & 51 deletions

File tree

‎.github/workflows/pythonapp.yml‎

Lines changed: 1 addition & 1 deletion

‎.pre-push-config.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ repos:
4242
hooks:
4343
- id: integration
4444
name: integration
45-
entry: pytest tests/integration
45+
entry: pytest recipes/minimal_examples
4646
language: python
4747
pass_filenames: False
4848
always_run: True

‎recipes/minimal_examples/neural_networks/ASR_CTC/params.yaml‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,6 @@ train_loader: !speechbrain.data_io.data_io.DataLoaderFactory
1717
csv_file: !ref <csv_train>
1818
batch_size: !ref <N_batch>
1919
csv_read: [wav, spk_id]
20-
output_folder: !ref <output_folder>
2120
replacements:
2221
$data_folder: !ref <data_folder>
2322

recipes/minimal_examples/neural_networks/ASR_CTC/experiment.py renamed to recipes/minimal_examples/neural_networks/ASR_CTC/test_asr_ctc_experiment.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -57,6 +57,8 @@ def on_epoch_end(self, epoch, train_stats, valid_stats):
5757
test_stats = ctc_brain.evaluate(params.test_loader())
5858
print("Test PER: %.2f" % summarize_error_rate(test_stats["PER"]))
5959

60+
6061
# For such a small dataset, the PER can be unpredictable.
6162
# Instead, check that at the end of training, the error is acceptable.
62-
assert summarize_average(test_stats["loss"]) < 2.0
63+
def test_error():
64+
assert summarize_average(test_stats["loss"]) < 15.0

‎recipes/minimal_examples/neural_networks/ASR_DNN_HMM/params.yaml‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,6 @@ train_loader: !speechbrain.data_io.data_io.DataLoaderFactory
1717
csv_file: !ref <csv_train>
1818
batch_size: !ref <N_batch>
1919
csv_read: [wav, ali]
20-
output_folder: !ref <output_folder>
2120
replacements:
2221
$data_folder: !ref <data_folder>
2322

recipes/minimal_examples/neural_networks/ASR_DNN_HMM/experiment.py renamed to recipes/minimal_examples/neural_networks/ASR_DNN_HMM/test_asr_dnn_hmm_experiment.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -53,5 +53,7 @@ def on_epoch_end(self, epoch, train_stats, valid_stats):
5353
test_stats = asr_brain.evaluate(params.test_loader())
5454
print("Test error: %.2f" % summarize_average(test_stats["error"]))
5555

56+
5657
# With such a small dataset, we only expect to get 35% correct
57-
assert summarize_average(test_stats["error"]) < 0.65
58+
def test_error():
59+
assert summarize_average(test_stats["error"]) < 0.65

recipes/minimal_examples/neural_networks/autoencoder/experiment.py renamed to recipes/minimal_examples/neural_networks/autoencoder/test_auto_experiment.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -66,5 +66,7 @@ def on_epoch_end(self, epoch, train_stats, valid_stats):
6666
test_stats = auto_brain.evaluate(params.test_loader())
6767
print("Test loss: %.3f" % summarize_average(test_stats["loss"]))
6868

69+
6970
# If training is successful, reconstruction loss is less than 0.2
70-
assert summarize_average(test_stats["loss"]) < 0.2
71+
def test_loss():
72+
assert summarize_average(test_stats["loss"]) < 0.2

‎recipes/minimal_examples/neural_networks/speaker_identification/params.yaml‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,6 @@ train_loader: !speechbrain.data_io.data_io.DataLoaderFactory
1717
csv_file: !ref <csv_train>
1818
batch_size: !ref <N_batch>
1919
csv_read: [wav, spk_id]
20-
output_folder: !ref <output_folder>
2120
replacements:
2221
$data_folder: !ref <data_folder>
2322

recipes/minimal_examples/neural_networks/speaker_identification/experiment.py renamed to recipes/minimal_examples/neural_networks/speaker_identification/test_spkid_experiment.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -54,5 +54,7 @@ def on_epoch_end(self, epoch, train_stats, valid_stats):
5454
test_stats = spk_id_brain.evaluate(params.test_loader())
5555
print("Test error: %.2f" % summarize_average(test_stats["error"]))
5656

57+
5758
# If training is successful, we get all test examples correct
58-
assert summarize_average(test_stats["error"]) == 0.0
59+
def test_error():
60+
assert summarize_average(test_stats["error"]) == 0.0

‎speechbrain/data_io/data_io.py‎

Lines changed: 8 additions & 9 deletions

0 commit comments

Comments
 (0)