SysMLV2 Benchmark

This repository explores the capabilities of GenAi for SysML v2 automatic generation.

Name		Name	Last commit message	Last commit date
Latest commit History 9 Commits
__pycache__		__pycache__
clustering		clustering
data		data
embedding_comparaison		embedding_comparaison
metrics		metrics
prompts		prompts
results		results
results_raw		results_raw
results_test		results_test
stats		stats
OLLAMA_EVALUATION_README.md		OLLAMA_EVALUATION_README.md
QUICK_START.md		QUICK_START.md
README.md		README.md
benchmark.py		benchmark.py
check_ollama_models.py		check_ollama_models.py
embeddings		embeddings
eval_ollama_full.py		eval_ollama_full.py
extract_data_pairs.py		extract_data_pairs.py
prompt_gen.py		prompt_gen.py
requirements.txt		requirements.txt
summarize_results.py		summarize_results.py
sysmlv2_data_pairs.json		sysmlv2_data_pairs.json
test_ollama_quick.py		test_ollama_quick.py
test_run.py		test_run.py
utilities.py		utilities.py

Provide feedback