Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
5646543
Init benchmark tool
dougppaz Jul 20, 2018
bf57ee3
Added first version of the automated test
periclesJ Jul 25, 2018
ee7fcf9
Update that allow automated training and predictions from jsons
periclesJ Jul 31, 2018
f925cab
Add .editorconfig
dougppaz Jul 31, 2018
792eb06
Add global config file and yaml support
dougppaz Jul 31, 2018
1069988
Add .gitignore and LICENSE
dougppaz Jul 31, 2018
a752816
Add run to nlu_benchmark.cli
dougppaz Jul 31, 2018
a3001a5
updates on main
periclesJ Aug 2, 2018
08d948b
Move version 1, add logger
dougppaz Aug 3, 2018
4a28b6c
Added decode from expressions.json from wit.ai
periclesJ Aug 7, 2018
c4a813e
updated scripts
periclesJ Aug 9, 2018
295c411
Add train examples in bothub
dougppaz Aug 10, 2018
8d77905
Add type test
dougppaz Aug 10, 2018
f010fd6
Updated report generator
periclesJ Aug 13, 2018
cf32c4d
small adjustment to avoid crashing
periclesJ Aug 14, 2018
aa8421f
Init test in run
dougppaz Aug 22, 2018
aed1ceb
Merge branch 'benchmark' of https://github.com/Ilhasoft/bothub into b…
dougppaz Aug 22, 2018
91f7cd5
Added bothub training from wit zipfile
periclesJ Aug 22, 2018
23cc208
Merge branch 'benchmark' of https://github.com/Ilhasoft/bothub into b…
periclesJ Aug 22, 2018
649aa41
Started working on the csv file generation
periclesJ Aug 22, 2018
276baa5
Working on csv file output
periclesJ Aug 24, 2018
57d43a6
bothub report finished
periclesJ Aug 30, 2018
57c9e79
Finished script...it needs some test
periclesJ Aug 30, 2018
d26c5a1
Finished report generator
periclesJ Aug 31, 2018
faa6ae7
Working on the new bothub version
periclesJ Sep 4, 2018
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
.vscode/
9 changes: 9 additions & 0 deletions benchmark/.editorconfig
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
root = true

[*]
indent_style = space
indent_size = 4
end_of_line = lf
charset = utf-8
trim_trailing_whitespace = true
insert_final_newline = true
3 changes: 3 additions & 0 deletions benchmark/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
*-mockup.txt
.bothub-service.yaml
*.log
674 changes: 674 additions & 0 deletions benchmark/LICENSE

Large diffs are not rendered by default.

16 changes: 16 additions & 0 deletions benchmark/Pipfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"

[packages]
plac = "*"
requests = "*"
pyyaml = "*"
tqdm = "*"

[dev-packages]
"flake8" = "*"

[requires]
python_version = "3.6"
120 changes: 120 additions & 0 deletions benchmark/Pipfile.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Binary file added benchmark/datafiles/Benchmark_Training.zip
Binary file not shown.
32 changes: 32 additions & 0 deletions benchmark/datafiles/binary.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
language: en
train:
- text: "yes"
intent: "affirmative"
- text: "yeap"
intent: "affirmative"
- text: "okay"
intent: "affirmative"
- text: "of course"
intent: "affirmative"
- text: "no"
intent: "negative"
- text: "nop"
intent: "negative"
- text: "not"
intent: "negative"
- text: "maybe"
intent: "maybe"
- text: "maybe yes"
intent: "maybe"
- text: "maybe no"
intent: "maybe"
tests:
- text: "yes"
expected:
- intent: "affirmative"
- text: "no"
expected:
- intent: "negative"
- text: "maybe"
expected:
- intent: "maybe"
Loading