Skip to content

Parallelisation Work #10

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
MarcusHatton wants to merge 114 commits into
base: generalising
Choose a base branch
from
Open

Parallelisation Work #10

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
114 commits
Select commit Hold shift + click to select a range
7107f53
TC update + Box_filter class
ThomasCelora May 1, 2023
903623d
Merging with MH
ThomasCelora May 1, 2023
041c8bf
TC update + Box_filter class
ThomasCelora May 1, 2023
c355ddc
TC update + Box_filter class
ThomasCelora May 1, 2023
6a515af
TC updates to interpolation methods
ThomasCelora May 23, 2023
788becc
Update to interpol + structures, stuff moved to base
ThomasCelora May 25, 2023
51311cf
Update to interpol + structures, stuff moved to base
ThomasCelora May 25, 2023
ae8d616
Added class for finding obs via root-finding
ThomasCelora May 26, 2023
ad212eb
TC latest update
ThomasCelora Jun 13, 2023
7630fd1
Merging with MH
ThomasCelora Jun 13, 2023
be09fbc
Merging with MH
ThomasCelora Jun 13, 2023
81b689d
Merging with MH
ThomasCelora Jun 13, 2023
a5bdefd
Merging with MH
ThomasCelora Jun 13, 2023
7ff01c4
TC work on MHD meso class
ThomasCelora Jul 19, 2023
389410f
Work on MHD meso class
ThomasCelora Sep 18, 2023
567eee0
Merge branch 'generalising' of https://github.com/ThomasCelora/Filter…
ThomasCelora Sep 18, 2023
7314516
Syncing with MH, work on resMHD
ThomasCelora Sep 18, 2023
79e7f09
TC tweaks on Visualization tools.
ThomasCelora Sep 20, 2023
b6b0cd6
TC tweaks to visualization tools
ThomasCelora Sep 20, 2023
7ea76c3
TC updates to get data methods
ThomasCelora Sep 20, 2023
4b83d38
TC tweaks to visualization tools
ThomasCelora Sep 21, 2023
aed37b2
Tweaks to MicroModels
ThomasCelora Sep 21, 2023
f653a79
TC update to derivatives method
ThomasCelora Sep 22, 2023
35c6316
TC restructuring analysis
ThomasCelora Oct 17, 2023
553e2c5
TC work on regression + visualizing correlations
ThomasCelora Oct 19, 2023
0dd74da
TC work on tensor regression
ThomasCelora Oct 20, 2023
fe74626
TC work on tensor regression
ThomasCelora Oct 20, 2023
6a7879b
TC update to regression routines: weighted + sklearn
ThomasCelora Oct 20, 2023
508fb0b
TC work PCA tools
ThomasCelora Oct 25, 2023
6c336ab
TC work on eta+kappa via squaring
ThomasCelora Nov 1, 2023
4de1511
FileReader: add rouitne to get domain vars not written by METHOD
ThomasCelora Nov 6, 2023
a53c335
Restructuring folder
ThomasCelora Nov 7, 2023
4403aa2
TC updates to Visualization.py
ThomasCelora Nov 17, 2023
3548a17
Resctructuring folder
ThomasCelora Nov 17, 2023
ad93753
TC update to Visualization.py
ThomasCelora Nov 17, 2023
b714777
TC changes to find observers and filter on a patch of mesogrid
ThomasCelora Nov 20, 2023
7ee7d89
TC update to micro:storing also bar_vel
ThomasCelora Nov 20, 2023
6bfad57
Fixing bug in get_var_data
ThomasCelora Nov 22, 2023
03a9bc6
Update to Visualization: plotting rel difference
ThomasCelora Nov 27, 2023
87cbb02
Fixing issue with smaller ranges
ThomasCelora Nov 30, 2023
ec5679c
First attempt to parallelize routines
ThomasCelora Dec 5, 2023
8362aa0
No gain in parallelizing setup_structures
ThomasCelora Dec 6, 2023
a383810
Parallelizing finding observers with multiprocessing
ThomasCelora Dec 6, 2023
897a699
Parallelizing filtering class
ThomasCelora Dec 7, 2023
10df804
Folder for Proof of Principle
ThomasCelora Dec 9, 2023
3407074
Config file for job array + slurm submit script
ThomasCelora Dec 10, 2023
19fd30f
script for testing parallel implementation
ThomasCelora Dec 11, 2023
a898fb9
script for testing parallel implementation
ThomasCelora Dec 11, 2023
cd3db40
Config file for job array + slurm submit script
ThomasCelora Dec 11, 2023
5104f91
Adding set method to parallel filer
ThomasCelora Dec 12, 2023
a685bba
Redoing proof of principle in one go
ThomasCelora Dec 12, 2023
290bd39
Removing deleted files from tracking
ThomasCelora Dec 12, 2023
926d391
Fixing minor bug in parallel routines
ThomasCelora Dec 14, 2023
415884c
Update: number of processes is now chosen at the MesoModel level
ThomasCelora Dec 14, 2023
a0f171e
Parallelizing meso-routines: decompose_structures + closure_ingredien…
ThomasCelora Dec 15, 2023
00ddcb9
TC Updates to master_files
ThomasCelora Jan 10, 2024
9b4630e
TC cleaning up Proof of principle
ThomasCelora Jan 10, 2024
e6bce26
Configuration files for PoP scripts
ThomasCelora Jan 10, 2024
2a1d8c6
Fixing bug in SET decomposition
ThomasCelora Jan 12, 2024
b82d45d
Testing and fixing closure_ingredient_task
ThomasCelora Jan 15, 2024
c728f32
Cleaning PoP repo
ThomasCelora Jan 15, 2024
c7c558b
Testing and fixing closure_igredients_task
ThomasCelora Jan 15, 2024
d0431a0
Update to PoP mainfile: adding tested routines
ThomasCelora Jan 15, 2024
1e8a916
Update to PoP mainfile: adding tested routines
ThomasCelora Jan 15, 2024
a40b14d
Removing unneeded files from master
ThomasCelora Jan 15, 2024
f6f02e6
Update: plot_vars_models_comparison now uses automatically raw data w…
ThomasCelora Jan 22, 2024
2edf79f
Implementing a user-defined symlog norm
ThomasCelora Feb 1, 2024
fcab681
Improving the parallelization
ThomasCelora Feb 1, 2024
0467c5c
Updates to PoP routines
ThomasCelora Feb 1, 2024
556f828
Adding routine to visualize coefficients to PoP
ThomasCelora Feb 1, 2024
c4a7550
Updates to PoP routines
ThomasCelora Feb 8, 2024
3154ecd
Adding dictionary for plots etc
ThomasCelora Feb 8, 2024
625c2e7
Work on regression routine + visualize correlations
ThomasCelora Feb 8, 2024
e816e6a
Tracking routines to visualize and regress over residuals
ThomasCelora Feb 8, 2024
178aa96
Tracking routines to visualize and regress over residuals
ThomasCelora Feb 8, 2024
ae2826f
Adding methods to preprocess data
ThomasCelora Feb 9, 2024
470e9c8
Adding methods to preprocess data
ThomasCelora Feb 9, 2024
0194efa
Preprocess inside regression etcetera
ThomasCelora Feb 16, 2024
749bacd
Tests and updates to PCA and regression routines and associated PoP s…
ThomasCelora Feb 16, 2024
26ef074
Updates to PoP
ThomasCelora Feb 16, 2024
2064492
Adding routine to compute various quantities for modelling extracted …
ThomasCelora Feb 21, 2024
26bd155
Work on routines and scripts to model the extracted coefficients
ThomasCelora Feb 21, 2024
d16e39c
Adding submit scripts
ThomasCelora Feb 22, 2024
d1b1d12
pushing latest versions of stuff
ThomasCelora Feb 22, 2024
3d55532
Fixing bug in modelling_coefficients_parallel
ThomasCelora Feb 26, 2024
be78650
Adding r-value to correlation plots + speeding up random extraction
ThomasCelora Feb 27, 2024
3f80bce
changes to preprocess data: now you can control which ranges not just…
ThomasCelora Feb 27, 2024
f732ca2
Corresponding updates to PoP routines
ThomasCelora Feb 27, 2024
7b92de6
Better looking correlation plots
ThomasCelora Feb 28, 2024
d35c267
Adding routines to compute weights based on Q-criterion + testing the…
ThomasCelora Mar 4, 2024
6765f7b
Adding routines for weighed Pearson, and options for showing this on …
ThomasCelora Mar 4, 2024
ef499ef
Adding weighted pearson to visualize_many_correlations plots
ThomasCelora Mar 5, 2024
2127ec0
Work on routines for adding weigths to regression etc
ThomasCelora Mar 5, 2024
3203418
Updates to my_symlog plotting routines: taking care of values very cl…
ThomasCelora Mar 7, 2024
b546fd9
Adding residual weighing routine and modifying PoP files accordingly
ThomasCelora Mar 7, 2024
8448f03
Adding residual weighing routine and modifying PoP files accordingly
ThomasCelora Mar 7, 2024
8411c78
Adding annotation box to hunting correlation scatter plot
ThomasCelora Mar 8, 2024
98b4449
Fixing bug in trim_data + optimizing the train test split
ThomasCelora Mar 11, 2024
d9e2a37
Changes to origin for visualization.py, this was inconsistent with th…
ThomasCelora Mar 21, 2024
5bf1660
Updates to masterfiles
ThomasCelora Mar 22, 2024
bf8dcc5
Transposing the data etc so that plot axis are not flipped wrt usual
ThomasCelora Mar 28, 2024
a1b485d
Updates to master files
ThomasCelora Apr 8, 2024
c129d16
Restructuring PoP + adding scripts for draft
ThomasCelora Apr 8, 2024
3ab0a35
No real updates, just polishing
ThomasCelora Apr 12, 2024
0dc1ef6
Routine to check for residual scaling
ThomasCelora Apr 12, 2024
1083f7b
Adding routine to check residual scaling with filter size
ThomasCelora Apr 22, 2024
d70e926
Adding routines to compute coeff componentwise in parallel
ThomasCelora Apr 25, 2024
595ce35
Adding more closure ingredients
ThomasCelora Apr 25, 2024
2017eb6
going back to computing the EoS residual separately
ThomasCelora Apr 25, 2024
f1acb75
cleaning repo
ThomasCelora May 7, 2024
2daf41a
minor updates to master classes
ThomasCelora May 7, 2024
7a66f20
Polishing filter scripts folder
ThomasCelora May 7, 2024
2b9c5d9
cleaning calibration and draft scripts folders
ThomasCelora May 7, 2024
7bb0723
tracking newest scripts
ThomasCelora May 7, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
69 changes: 0 additions & 69 deletions Analysis.py
View file
Open in desktop

This file was deleted.

125 changes: 0 additions & 125 deletions FileReaders.py
View file
Open in desktop

This file was deleted.

Loading