Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
220 commits
Select commit Hold shift + click to select a range
11e36ee
WPT Bayesian inversion with heterogeneous Young modulus.
jstebel Jun 26, 2025
09cfd9f
Update plots
bagr-sus Jul 14, 2025
8bbd0b9
Update events
bagr-sus Jul 14, 2025
b6e7db1
remove event loading
bagr-sus Jul 14, 2025
f101866
Change to newer measurement file
bagr-sus Jul 14, 2025
b96dde3
Fix plot call
bagr-sus Jul 14, 2025
3aedf48
Swap proposal to DREAMZ
bagr-sus Jul 14, 2025
a66bf0e
Add additional data to idata
bagr-sus Jul 14, 2025
698d0ce
Fix imports
bagr-sus Jul 14, 2025
cb4d7ab
Change parameter names to accomodate new model
bagr-sus Jul 14, 2025
b03112c
Fix plotting for newer version of mpl
bagr-sus Jul 14, 2025
77b271e
Fix return of main sampling call
bagr-sus Jul 14, 2025
89f2842
Uncomment pressure test loading
bagr-sus Jul 14, 2025
458758c
Add multipacker to inputs file
bagr-sus Jul 14, 2025
ca8169f
Update time on pressure test to match simulation
bagr-sus Jul 14, 2025
57c2778
Add test loading to inversion
bagr-sus Jul 14, 2025
1e3b933
Try different priors
bagr-sus Jul 14, 2025
80e6cb7
Add chain modularity
bagr-sus Jul 14, 2025
eaffc3a
Lower initial archive size
bagr-sus Jul 14, 2025
0ab7928
Increase size of trace plot to account for number of variables
bagr-sus Jul 14, 2025
bf035a8
Remove debug prints
bagr-sus Jul 14, 2025
f0b22e7
Remove burn in
bagr-sus Jul 16, 2025
cc0103d
Update max number of plots
bagr-sus Jul 16, 2025
10fb23b
Update plots
bagr-sus Jul 18, 2025
7259d56
change prior to match other branch
bagr-sus Jul 18, 2025
c3630ed
Add loading of spotreba sigma
bagr-sus Jul 23, 2025
2626ab4
Add additional columns
bagr-sus Jul 23, 2025
e9d02b0
Match params to other branch
bagr-sus Jul 28, 2025
dff97b1
Match events to other branch
bagr-sus Jul 28, 2025
4929e68
Add loading of dt
bagr-sus Jul 28, 2025
1fe7859
Add extended observe
bagr-sus Jul 28, 2025
e5d4e5c
Add extended observe to idata
bagr-sus Jul 28, 2025
fcfa2a1
Update plot_observe
bagr-sus Jul 28, 2025
7db5002
Limit likelihood plot to 10k
bagr-sus Jul 28, 2025
dc210e2
remove duplicate plot
bagr-sus Jul 28, 2025
ce7d425
Update priors to match branches
bagr-sus Jul 28, 2025
16d2a80
Update number of bins to match branches
bagr-sus Jul 28, 2025
ee8e6d0
Remove removal of first observe variable
bagr-sus Jul 28, 2025
c5ab637
Update multipacker
bagr-sus Aug 1, 2025
aeb062a
Update multipacker v2
bagr-sus Aug 1, 2025
05cd8de
Update likelihood plot to log scale
bagr-sus Aug 1, 2025
30e45e3
Update to new model with flux model output
bagr-sus Aug 10, 2025
e588a57
Add new interpolation method
bagr-sus Aug 10, 2025
4bc8a61
Remove old interpolation and use new one
bagr-sus Aug 10, 2025
1d4d3c8
Update events to test out new interpolation
bagr-sus Aug 10, 2025
8684e0b
Scripts to switch from main tinyda to tinyda fork
bagr-sus Aug 13, 2025
7b16b71
Switch sign on flux equation?
bagr-sus Aug 13, 2025
bca185a
Convert model output to numpy array
bagr-sus Aug 13, 2025
172f5ab
Different prior for p_far
bagr-sus Aug 13, 2025
0fb710e
Different observed output like in the other branch
bagr-sus Aug 13, 2025
037adaf
Move part of sampling config
bagr-sus Aug 13, 2025
ea1e70d
Add DREAM proposal
bagr-sus Aug 13, 2025
02f87f7
Rework idata additions
bagr-sus Aug 13, 2025
e6db710
Rework observe plot to include histogram of flow values
bagr-sus Aug 13, 2025
6413d64
Remove tinyDA from requirements in favor of fork
bagr-sus Aug 13, 2025
cc8b425
Remove limit on likelihood plot values
bagr-sus Aug 13, 2025
7882957
Add new events
bagr-sus Sep 2, 2025
31edbd0
Update init
bagr-sus Sep 2, 2025
fe7ac33
Update main
bagr-sus Sep 2, 2025
fe30f95
Move plots over to separate file
bagr-sus Sep 2, 2025
db13878
Add import of plots
bagr-sus Sep 2, 2025
e0f308c
Simplified requirements.
jbrezmorf Sep 3, 2025
e06af27
Extract generic name getter into its own method
bagr-sus Sep 9, 2025
d52589d
Use new generic name method
bagr-sus Sep 9, 2025
a495991
Actually print the idata summary lol
bagr-sus Sep 9, 2025
762a4d5
Add observed flow rate distribution to observe plot
bagr-sus Sep 9, 2025
2a42d2c
Add branch in posterior plot to handle single parameter plots
bagr-sus Sep 9, 2025
84465c9
remove unused
bagr-sus Sep 9, 2025
f1c59fe
New way of setting tick density in likelihood plots
bagr-sus Sep 9, 2025
45cc246
Lower flow rate sigma
bagr-sus Sep 9, 2025
50ff015
New parent plotting function to plot all plots in one
bagr-sus Sep 9, 2025
133205f
New formatter
bagr-sus Sep 9, 2025
953185e
add merged plot to plotting sweep
bagr-sus Sep 9, 2025
c691a20
Geometric parameter for nonuniform mesh in WPT model, concentrated at…
jstebel Sep 10, 2025
fc3c892
Increase correlation length
bagr-sus Sep 15, 2025
1c3307f
Merge remote-tracking branch 'origin/JS_geom_parameters' into OS_wpt_…
bagr-sus Sep 15, 2025
09dd39e
Improve script launching
bagr-sus Sep 17, 2025
fa5dec6
Remove cutoff at the end of inference and add info of cutoff legth
bagr-sus Sep 17, 2025
765c816
Reduce number of nodes
bagr-sus Sep 17, 2025
ea18230
Add a failsafe to forward model in case of singular matrix error
bagr-sus Sep 17, 2025
494b68b
Change params
bagr-sus Sep 17, 2025
a1cba98
Debug prints
bagr-sus Sep 17, 2025
5caaa96
Add two new events at existing boreholes
bagr-sus Sep 17, 2025
6a96903
Change ax limits in trace plot to unify parameters across groups E and k
bagr-sus Sep 17, 2025
c223a5b
Move removal of burnin to plotting
bagr-sus Sep 17, 2025
a371160
Fix normalization of pdf to match histogram
bagr-sus Sep 17, 2025
f820384
Add run all script
bagr-sus Sep 17, 2025
f2e0316
Change geometric power to lower value
bagr-sus Sep 17, 2025
b8d448a
Add support from writing idata to and from files
bagr-sus Sep 17, 2025
70f77d2
add an import to init
bagr-sus Sep 17, 2025
36082a3
Add additional parameter to plot_likelihood
bagr-sus Sep 17, 2025
d9f4d7b
Get rid of other plots other than the merged one
bagr-sus Sep 17, 2025
a12ad5a
Add processing of uncut data
bagr-sus Sep 17, 2025
1227c32
Use unuct data to display under cut data in likelihood plots
bagr-sus Sep 17, 2025
d11b0d7
Increase iteration count
bagr-sus Sep 17, 2025
dccb818
Add pbs params
bagr-sus Sep 17, 2025
b60ea92
Remove comments?
bagr-sus Sep 17, 2025
21462ed
Add charon queue to job params
bagr-sus Sep 17, 2025
b64777d
fix activate path
bagr-sus Sep 17, 2025
31ec944
add cd to workdir
bagr-sus Sep 17, 2025
64fa80b
Fix venv path
bagr-sus Sep 17, 2025
daf8e3a
Specify python version more
bagr-sus Sep 17, 2025
a9f94d8
Update run script
bagr-sus Sep 17, 2025
5962a74
Remove previous param check
bagr-sus Sep 17, 2025
4a9600d
Try to fix weird matplotlib error
bagr-sus Sep 17, 2025
b84760d
Change backend to something that should run on cluster
bagr-sus Sep 17, 2025
0615fc6
Change export to happen after venv activation
bagr-sus Sep 17, 2025
d2c2e27
Change events to reduce size of idata and memory usage
bagr-sus Sep 18, 2025
d1c02d2
Add more memory to pbs script
bagr-sus Sep 18, 2025
0588a05
Rework flow rate output to be ignored when unspecified
bagr-sus Sep 22, 2025
20e6004
Add new params to dream
bagr-sus Sep 22, 2025
cfcb712
Update run all with more ram and higher default N value
bagr-sus Sep 22, 2025
786a398
Add all remaining WPTs (except newer 22DR)
bagr-sus Sep 22, 2025
ea652d9
Extend walltime on run script
bagr-sus Sep 22, 2025
5d130ad
Increase time step for most memory hungry events
bagr-sus Sep 23, 2025
1e66e31
Move idata stuff to its own file
bagr-sus Sep 23, 2025
83abff4
Increase memory allocation for run script
bagr-sus Sep 23, 2025
6ab5ba1
add idata tools to init
bagr-sus Sep 23, 2025
8b15167
add solver radii to idata
bagr-sus Sep 23, 2025
bfd6efb
Change naming scheme for plot filenames
bagr-sus Sep 23, 2025
bcbdc22
Rewrite observe plot to allow choice between plots
bagr-sus Sep 23, 2025
a31e439
Change labels to english to be consistent
bagr-sus Sep 23, 2025
5469291
Add passing of axes parameter to hist2d plot and use radii from idata
bagr-sus Sep 23, 2025
4266154
Add a compare plot to compare two idatas
bagr-sus Sep 23, 2025
94aa5a7
import for compare plot
bagr-sus Sep 23, 2025
a4238d1
Run script for plot_compare
bagr-sus Sep 23, 2025
be7c279
Fix figure appending and bug in observe plot
bagr-sus Sep 24, 2025
47e12a5
Comment out done events
bagr-sus Sep 24, 2025
a4e2586
Remove problematic event temporarily
bagr-sus Sep 24, 2025
576c254
Enable first batch of events
bagr-sus Sep 28, 2025
f54771a
Disable 23UR_2 as it does not work for some reason
bagr-sus Sep 28, 2025
24e6748
Comment out all but last three events
bagr-sus Sep 28, 2025
1b4165d
Add the time series in days to idata
bagr-sus Oct 15, 2025
3b2841b
Move removing of burn in into its own method
bagr-sus Oct 15, 2025
2761787
Use new remove burn in
bagr-sus Oct 15, 2025
2022f7d
Remove unused
bagr-sus Oct 15, 2025
0b68cb7
Fix compare plot using idata with burn in
bagr-sus Oct 15, 2025
0534a19
Rework plot_observe to align data differently
bagr-sus Oct 15, 2025
b7e24de
new call of plot_observe
bagr-sus Oct 15, 2025
870ea6f
Better figsize assignment
bagr-sus Oct 15, 2025
493f809
Improved compare plot
bagr-sus Oct 15, 2025
4c52f72
Update events to inclued all except 23UR section 2
bagr-sus Oct 15, 2025
d581b8e
Add remove burnin to ini xd
bagr-sus Oct 16, 2025
6a28754
New compare plot grid
bagr-sus Oct 16, 2025
6d670d3
Remove point estimate from posterior plots
bagr-sus Nov 5, 2025
72819a8
Remove 2d hist from observe plot, relocated elsewhere
bagr-sus Nov 5, 2025
5582f4d
Remove suptitle calls from subplot functions
bagr-sus Nov 5, 2025
a74b699
Add import
bagr-sus Nov 5, 2025
c8feb60
Add cmap arg to 2d posterior hist plot
bagr-sus Nov 5, 2025
92db62b
Remove point estimate from posterior plots, pt 2
bagr-sus Nov 5, 2025
6a65993
Fix idata loading to always load 2024 data first and 2025 data second
bagr-sus Nov 5, 2025
1ec6ec3
Nicer histogram call
bagr-sus Nov 5, 2025
7b9665b
Plot function for pressure fit error distribution
bagr-sus Nov 5, 2025
dc14954
Change internal naming for better usability
bagr-sus Nov 5, 2025
9ba4404
Include fit error plot in compare plot
bagr-sus Nov 5, 2025
02ab0b0
Change subplot grid setup for a better look
bagr-sus Nov 5, 2025
b0ec5bd
Fix width and offset values to be data independent
bagr-sus Nov 5, 2025
3732b9e
Fix x-axis for E parameter posteriors to a static value
bagr-sus Nov 5, 2025
2e67d56
Increase prior deviation for E params
bagr-sus Nov 5, 2025
c532d35
Lower E prior by an order of magnitude
bagr-sus Nov 5, 2025
df2a6ee
Convert the inversion to work with kPa instead for better numerical s…
bagr-sus Nov 5, 2025
660cec4
Adjustments to events
bagr-sus Nov 5, 2025
d200ff0
Comment out finished events and hopefully fix one that failed (23UR0)
bagr-sus Nov 6, 2025
6227c9f
Fix incorrect labels
bagr-sus Nov 9, 2025
b9d91e1
Add update of piezo dataset.
jbrezmorf Dec 2, 2025
11f2526
Add ability to force unknown flow values
bagr-sus Dec 10, 2025
6f1429a
Disable all 2024 events
bagr-sus Dec 10, 2025
1ccd0c9
Add missing import
bagr-sus Dec 10, 2025
b8de853
Fix import pt2
bagr-sus Dec 10, 2025
eefa4c5
Fix import v3
bagr-sus Dec 10, 2025
d9fcdee
Add back default param value
bagr-sus Dec 10, 2025
97f04f3
Update gitignore
bagr-sus Dec 10, 2025
046d330
Update gitignore v2
bagr-sus Dec 10, 2025
90b0de7
Update the latest datafile
jbrezmorf Dec 11, 2025
cc2f8b7
Merge branch 'OS_wpt_heterogenous_E' of github.com:GeoMop/endorse int…
jbrezmorf Dec 11, 2025
9272dfe
add new piezo file reference
bagr-sus Dec 17, 2025
8419781
Add 3 new events and reorder event a bit
bagr-sus Dec 17, 2025
ce64d86
Fix missing section for 23UR section 2
bagr-sus Dec 18, 2025
1f4e794
Isolate the last missing event
bagr-sus Dec 18, 2025
6bc3755
Isolate the last remaining event's completement
bagr-sus Dec 18, 2025
ef7d9a7
Enable 22DR 2025 events
bagr-sus Dec 18, 2025
b134a99
Disable uknown flow forcing
bagr-sus Dec 18, 2025
343d911
Update run all umask
bagr-sus Dec 21, 2025
1ed0913
First draft of summary table script
bagr-sus Dec 21, 2025
bd02d4d
Restrict file names so it doesn't take as long to generate summary
bagr-sus Dec 21, 2025
d5272d5
Change header check function
bagr-sus Dec 21, 2025
4dea9a8
Add encoding and change to append mode
bagr-sus Dec 21, 2025
478a752
New approach to checking if file has readable bytes
bagr-sus Dec 21, 2025
82d699d
Fix list appending to not append nested list
bagr-sus Dec 21, 2025
52a8f9e
Attempt #2
bagr-sus Dec 21, 2025
b9fb1e4
Header check needs a read mode file - separate it
bagr-sus Dec 21, 2025
0778ebb
Enable all events and raise p_far prior deviation
bagr-sus Dec 21, 2025
b4f3017
Reduce the variance a bit to hopefully increase stability
bagr-sus Dec 21, 2025
991f4a2
Toggle force unknown flow
bagr-sus Dec 21, 2025
da46c9e
Disable finished events
bagr-sus Dec 22, 2025
7232bcc
Raise mem limit for run all
bagr-sus Dec 22, 2025
7eaa163
Updated plots, rearranged events.yaml
jbrezmorf Dec 27, 2025
cf04b90
Merge branch 'OS_wpt_heterogenous_E' of github.com:GeoMop/endorse int…
jbrezmorf Dec 27, 2025
7cbdc88
Improved plots.
jbrezmorf Jan 6, 2026
f6242df
pressure summary extended by the manuay read pressures
jbrezmorf Jan 9, 2026
6703eff
Example boxplot config.
jbrezmorf Jan 9, 2026
5c32b77
Plot updates.
jbrezmorf Jan 12, 2026
7a1f2d4
Merge branch 'OS_wpt_heterogenous_E' of https://github.com/GeoMop/end…
bagr-sus Jan 13, 2026
d3b31e5
First boxplot attempt
bagr-sus Jan 14, 2026
d967c18
Try to fix positioning
bagr-sus Jan 14, 2026
19a2154
More formatting
bagr-sus Jan 14, 2026
b8fbc66
Remove wrong args
bagr-sus Jan 14, 2026
5f7232b
fix coloring hopefully
bagr-sus Jan 14, 2026
134104a
Remove excess whitespaces
bagr-sus Jan 21, 2026
fb4c159
Remove list reversal for order of boreholes
bagr-sus Jan 21, 2026
32c4b35
Change directory to be just the rundir
bagr-sus Jan 21, 2026
e33f9c9
Add debug print to check the borehole order at runtime
bagr-sus Jan 21, 2026
9ee2b84
Switch to a sorted DF
bagr-sus Jan 21, 2026
f79957f
More debug prints
bagr-sus Jan 21, 2026
7876fee
Add warning if no figures are passed
bagr-sus Feb 12, 2026
0a28c80
Remove unused
bagr-sus Feb 12, 2026
750831b
Add synthetic model testing
bagr-sus Feb 12, 2026
43fb57b
Synthetic testing updates
bagr-sus Mar 17, 2026
23098d6
Update README
bagr-sus Mar 17, 2026
c64aead
Merge remote-tracking branch 'origin/main' into OS_wpt_heterogenous_E
jbrezmorf Mar 20, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions apps/chodby_inv/.gitignore
Original file line number Diff line number Diff line change
@@ -1,2 +1,7 @@
workdir
**/workdir
outputs/
*.ssh*
*.pdf
tinyDA/
*.idata
24 changes: 24 additions & 0 deletions apps/chodby_inv/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,30 @@ This will install the Python application `invapp` from sources in editable form
the application dependencies including the `endorse` generic code package are
installed as well.

## Launching the app

The main script for the WPT inversion is located inside of `piezo/wpt_bayes.py` and expects one integer argument corresponding to the index of selected event inside of `input_data/events.yaml`. Pressure sensor data is read from `input_data/piezo*.xslx` files, measured event-specific quantities (flow rate, conductivity etc) are taken from `input_data/wpt_2025_04_with_flux_on_multipacker.xlsx`. Synthetic benchmarks script is contained in `piezo/synthetic.py`. Summary table data collection and creation is in `piezo/summary_table.py`. Comparison plots can be generated by running the `piezo/plots.py` with first argument being the chosen borehole and second argument being the chosen borehole section. The current working directory has to contain two `.idata` files for the corresponding borehole and section, one from 2024 and the other from 2025.


Python scripts can be launched as follows:

0) Create and setup the virtual environment
1) Activate the virtual environment
```
source venv/bin/activate
```
2) Launch the appropriate script file
```
python -m chodby_inv.piezo.<file_name>
```

For running the WPT inversion across all available events on metacentrum, run the bash script `run_all.sh` as follows:

```
qsub run_all.sh
```


## Structure

### [fitting](fitting/README.md)
Expand Down
1 change: 1 addition & 0 deletions apps/chodby_inv/input_data/.gitignore
Original file line number Diff line number Diff line change
@@ -1,2 +1,3 @@
/piezo_2024_11_27.xlsx
/piezo_2025_04_08.xlsx
/piezo_2025_09_24.xlsx
1 change: 1 addition & 0 deletions apps/chodby_inv/input_data/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,5 +36,6 @@ on large sections of the whole boreholes
measurement by GDS (small fluxes) or weighting the expansion vessel
must be merged with piezo file for full picture

`pressure_summary.csv` and `flow_summary.csv` are summary tables from the inversions of the WPTs

`resources` - supplementary documents from where the machine readable data were extracted
8 changes: 7 additions & 1 deletion apps/chodby_inv/input_data/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -14,8 +14,14 @@
#blast_events_xlsx = input_dir / 'blast_events.xlsx'

# smallest file
piezo_measurement_file = input_dir / "piezo_2024_06_04.xlsx"
#piezo_measurement_file = input_dir / "piezo_2024_06_04.xlsx"
# last file
#piezo_measurement_file = input_dir / "piezo_2025_04_08.xlsx"
piezo_measurement_file = input_dir / "piezo_2025_09_24.xlsx"
# configuration of the filtering sections
# named sections of the data corresponding to interesting time intervals

wpt_multipacker = input_dir / "wpt_2025_04_with_flux_on_multipacker.xlsx"

flow_summary_csv = input_dir / "flow_summary.csv"
pressure_summary_csv = input_dir / "pressure_summary.csv"
Loading
Loading