chn/bscpkgs
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
740 Commits 1 Branch 0 Tags 1.8 MiB
11a521ff51
Commit Graph

484 Commits

Author SHA1 Message Date
Rodrigo Arias Mallo
bfbbc294ae fwi: split into input and solver 
All branches compile with several hacks.
 2021-04-07 12:44:13 +02:00
Rodrigo Arias Mallo
9bea3cc264 fwi: add oss experiment 2021-04-07 12:44:13 +02:00
Rodrigo Arias Mallo
f10f8472ac fwi: add seq test experiment 2021-04-07 12:44:13 +02:00
Rodrigo Arias Mallo
26ad3e49f7 fwi: add gitBranch and copy params 2021-04-07 12:44:13 +02:00
Rodrigo Arias Mallo
312656ce54 heat: rename granul -> granularity experiment 2021-04-06 18:42:49 +02:00
Rodrigo Arias Mallo
63aa07dad5 heat: update granularity plot with modern ggplot 2021-04-06 18:40:19 +02:00
Rodrigo Arias Mallo
d1c32869c1 heat: split granularity with extended mode 
The HWC version is not yet complete.
 2021-04-06 18:38:15 +02:00
Rodrigo Arias Mallo
3566cf0152 develop: add paraver package 2021-04-06 11:14:30 +02:00
Rodrigo Arias Mallo
0b7e92b6f9 heat: add bar plot with time distribution 2021-04-06 11:05:56 +02:00
Rodrigo Arias Mallo
f8122f3c8b heat: use the hcut tool to limit the cpus 2021-04-06 11:05:56 +02:00
Rodrigo Arias Mallo
d68ce914ba heat: use cut to partition the trace 
The awk script doesn't take in consideration the events close to the cut
points, which are significative with low parallelism.
 2021-04-06 11:05:51 +02:00
Rodrigo Arias Mallo
cb482fa3ea heat: remove perf from the ctf experiment 
As we would be extracting perf stats from the trace processing steps.
 2021-04-06 11:05:10 +02:00
Rodrigo Arias Mallo
8a97fefafa saiph: simplify and update figure scripts 2021-04-01 19:25:38 +02:00
Rodrigo Arias Mallo
10b1ff8f7a saiph: simplify granularity and ss experiments 2021-04-01 19:25:38 +02:00
Rodrigo Arias Mallo
0e0f1b265f saiph: add extra parameters for the app 2021-04-01 19:25:38 +02:00
Rodrigo Arias Mallo
5ea9ff5ad8 machines: add cache sizes 2021-04-01 19:25:38 +02:00
Sandra
2b36e33b7e saiph: modify apps parameters 2021-04-01 19:25:37 +02:00
Sandra
b64b864194 saiph: clean exps and figs 2021-04-01 19:25:37 +02:00
Sandra
72e7a8dab7 shell: add clangOmpss2 and gdb 2021-04-01 19:25:24 +02:00
Sandra
46536548ca saiph: update scaling exp and figures 2021-04-01 19:24:38 +02:00
Sandra
8406c1c4e5 saiph: add total number of local blocks (#tasks) parameter 2021-04-01 19:24:38 +02:00
Sandra
bc912162a0 index: add vtk and boost 2021-04-01 19:24:38 +02:00
Sandra
4e727bf632 shell: add nix-diff 2021-04-01 19:24:38 +02:00
Sandra
5c7af00dfa saiph: add debug/asan flags parameters 2021-04-01 19:24:38 +02:00
Sandra
5caf2f79f3 saiph: change scaling R script 2021-04-01 19:24:38 +02:00
Sandra
a90c044c3e saiph: add manual global blocking 
Ensure cuts in a single dimension
 2021-04-01 19:24:38 +02:00
Sandra
99532c9c60 saiph: add manual distribution and nbl/nbg 2021-04-01 19:24:34 +02:00
Sandra
ddef901e2f saiph: add nsteps parameter to experiments 2021-03-30 18:54:35 +02:00
Sandra
1ae5acfe6a saiph: add nsteps in saiph app 2021-03-30 18:54:35 +02:00
Rodrigo Arias Mallo
d108306a29 saiph: add blocking experiments to index 
Remove unused environment variables as well.
 2021-03-30 18:54:35 +02:00
Rodrigo Arias Mallo
e0fbbe32a6 saiph: update granularity experiment and R script 2021-03-30 18:54:35 +02:00
Sandra
37e11c749f saiph: add cacheline compilation parameter 2021-03-30 18:54:35 +02:00
Sandra
02a62c18ac saiph: add strong scaling experiment 2021-03-30 18:54:35 +02:00
Sandra
0ac0205366 saiph: add figures for blocking experiment 2021-03-30 18:54:35 +02:00
Sandra
a2306eb941 saiph: add some blocking experiments 2021-03-30 18:54:35 +02:00
Sandra
38d4d0b48c saiph: delete extrae XML configuration files 2021-03-30 18:54:35 +02:00
Rodrigo Arias Mallo
63b08fa4e8 saiph: use nby for granularity plot 2021-03-30 18:54:35 +02:00
Rodrigo Arias Mallo
992af14c7f saiph: add scaling experiment 2021-03-30 18:54:35 +02:00
Rodrigo Arias Mallo
99f3326609 saiph: allow custom gitCommit 2021-03-30 18:54:35 +02:00
Rodrigo Arias Mallo
a4b2dfddb4 saiph: update granularity experiment 2021-03-30 18:54:35 +02:00
Rodrigo Arias Mallo
830d648925 saiph: reduce the number of loops 
The current app Heat3D_vect has a long initialization time
 2021-03-30 18:54:16 +02:00
Rodrigo Arias Mallo
e4ab177d6c saiph: remove dangerous Intel MPI envvar 
It is no longer used, as we have moved to the release library version.
 2021-03-30 17:56:26 +02:00
Rodrigo Arias Mallo
b7dcf7bc69 rplot: add support for gziped datasets 2021-03-30 16:35:47 +02:00
Rodrigo Arias Mallo
5ac581b573 creams: remove pure mpi from granularity 2021-03-30 16:14:32 +02:00
Rodrigo Arias Mallo
b900cb95f0 creams: make configurations unique 2021-03-30 16:14:11 +02:00
Rodrigo Arias Mallo
389d3f6310 creams: simplify granularity figure 2021-03-30 16:07:14 +02:00
Rodrigo Arias Mallo
76deac0a63 creams: update figures using one single pipeline 2021-03-30 15:59:52 +02:00
Rodrigo Arias Mallo
87f751185c creams: merge similar experiments together 
Large experiments have the enableExtended parameter disabled by default,
which enables more tests.
 2021-03-30 15:55:57 +02:00
Rodrigo Arias Mallo
ec056d97e5 rplot: add total job time in the plots 2021-03-30 15:49:40 +02:00
Rodrigo Arias Mallo
872ad1a289 stdexp: allow preSrun attribute in the srun stage 
This option allows an experiment to inject commands before srun starts,
while keeping the standard srun stage options.
 2021-03-29 17:46:19 +02:00
Pedro Martinez
617ef21d38 creams: redefine granularity figures 2021-03-24 13:52:26 +01:00
Pedro Martinez
5cd9894636 creams: redefine granularity experiments 2021-03-24 13:52:26 +01:00
Pedro Martinez
bfc32ef4b7 creams: readjust granularity for strong scalability 2021-03-24 13:52:26 +01:00
Pedro Martinez
cb4d27aefb creams: bugfix in granularity values 2021-03-24 13:52:26 +01:00
Pedro Martinez
d27c696259 creams: reduce granularity combinations to 8 2021-03-24 13:52:26 +01:00
Pedro Martinez
a55019c6ef creams: add more nodes for granularity experiments 2021-03-24 13:52:26 +01:00
Rodrigo Arias Mallo
8a81c6bfba creams: add granularity figure 
Only the hybrid experiment is used by now
 2021-03-24 13:52:26 +01:00
Rodrigo Arias Mallo
c59f298ae2 creams: reduce granularity experiment units 2021-03-24 13:52:26 +01:00
Rodrigo Arias Mallo
6818b29d02 creams: fix outdated nanos6.toml 
This temporal fix allows the experiment to ignore the nanos6.toml in the
git repository, and only set version.dependencies variable.
 2021-03-24 13:52:26 +01:00
Pedro Martinez
8445fb0928 creams: run the cp command in one process only 2021-03-24 13:52:26 +01:00
Pedro Martinez
1aa0e77157 creams: avoid race condition 
Ensure only one Slurm process performs environment operations
 2021-03-24 13:52:26 +01:00
Pedro Martinez
938246322f creams: add OpenMP branches 2021-03-24 13:52:26 +01:00
Pedro Martinez
6c0f4ec1b3 creams: add granularity experiments 2021-03-24 13:52:26 +01:00
Rodrigo Arias Mallo
46f7add84c garlicd: use head instead of the read builtin 
It seems that bash is unable to propagate the SIGINT while
reading from the FIFO. This fixes the anoying ^C^C^C problems
found when running garlicd.
 2021-03-22 18:43:01 +01:00
Rodrigo Arias Mallo
87fa3bb336 sbatch: assert types to avoid silent parse errors 2021-03-19 16:37:31 +01:00
Rodrigo Arias Mallo
74cd3d4fbc rplot: fix fontconfig warning 2021-03-12 19:53:24 +01:00
Rodrigo Arias Mallo
c41456412c examples: Add granularity examples 2021-03-12 19:33:40 +01:00
Rodrigo Arias Mallo
7d66b34140 nbody: fix converter rename in nanos6 CTF options 2021-03-12 12:58:41 +01:00
Rodrigo Arias Mallo
0781e8b28e nbody: remove jemalloc experiments 
Nanos6 has jemalloc enabled by default
 2021-03-12 12:58:41 +01:00
Rodrigo Arias Mallo
88087bb4b7 nbody: add time-node plot 2021-03-12 12:58:41 +01:00
Rodrigo Arias Mallo
637c57b388 nbody: improve unit name 2021-03-12 12:58:41 +01:00
Rodrigo Arias Mallo
26ab2d9bbd nbody: fix indentation in baseline R script 2021-03-12 12:58:41 +01:00
Rodrigo Arias Mallo
133ef50bb4 nbody: show time points 2021-03-12 12:58:41 +01:00
Rodrigo Arias Mallo
3a2694ad36 nbody: add mpi branch in scaling experiment 2021-03-12 12:58:37 +01:00
Rodrigo Arias Mallo
5804b167db nbody: add scaling figure 2021-03-12 12:57:01 +01:00
Rodrigo Arias Mallo
425479c9fc nbody: add scaling experiment 2021-03-12 12:57:01 +01:00
Rodrigo Arias Mallo
a286488979 rplot: add egg package for ggarange function 2021-03-12 12:56:58 +01:00
Rodrigo Arias Mallo
d70adae9ec heat: add figure for the mode experiment 2021-03-12 12:14:51 +01:00
Rodrigo Arias Mallo
854707103c heat: add ctf stage to analyze mode times 2021-03-12 12:13:10 +01:00
Rodrigo Arias Mallo
972be56eed heat: patch to print the start and end time 
It will be used to cut the CTF traces to take only the computation part
in cosideration.
 2021-03-12 12:11:24 +01:00
Rodrigo Arias Mallo
56c625bfe4 ds: add ctf mode analysis 2021-03-12 12:10:18 +01:00
Rodrigo Arias Mallo
3445a72686 garlic tool: copy recursively from .garlic/ 
It allows an experiment to store a CTF trace in the resultTree (which is
not recommended for large traces).
 2021-03-12 11:13:35 +01:00
Rodrigo Arias Mallo
b192fc44f5 heat: refactor cache into granul experiment 2021-03-09 18:45:33 +01:00
Rodrigo Arias Mallo
7b4da07dbf heat: add more figures from perf counters 2021-03-09 18:21:59 +01:00
Rodrigo Arias Mallo
3bcbc62a98 fig: add fig.heat.cache to fig.article 2021-03-09 18:21:22 +01:00
Rodrigo Arias Mallo
52360c9459 rplot: add viridis R package 2021-03-09 18:20:40 +01:00
Rodrigo Arias Mallo
71a1396955 ds: parse time with perf generator 2021-03-09 11:07:19 +01:00
Rodrigo Arias Mallo
b600f64fcc heat: add cache miss experiment and figure 2021-03-05 18:31:31 +01:00
Rodrigo Arias Mallo
14fbb1499b ds: add perf stat parser 
We can only read one output file by now, located at:
.garlic/perf.csv
 2021-03-05 18:29:43 +01:00
Rodrigo Arias Mallo
c1efba1e65 heat: rename test -> granul experiment 2021-03-05 18:28:32 +01:00
Rodrigo Arias Mallo
29d7245135 heat: add figure with heatmap 2021-03-05 16:21:13 +01:00
Rodrigo Arias Mallo
363700eb9a heat: update test experiment 2021-03-05 16:18:51 +01:00
Rodrigo Arias Mallo
7e10a43b40 heat: update new app version 
The blocksize is now specified at runtime
 2021-03-05 16:16:06 +01:00
Rodrigo Arias Mallo
6b6b54f757 timetable: add total_time column 2021-03-03 19:00:36 +01:00
Rodrigo Arias Mallo
5afe819724 osu: add impi figure 2021-03-03 12:42:19 +01:00
Rodrigo Arias Mallo
651d91ef79 fig: improve indentation 2021-03-03 12:42:19 +01:00
Rodrigo Arias Mallo
14211c9895 osu: use ggsave and reduce verbosity 2021-03-03 12:42:19 +01:00
Rodrigo Arias Mallo
6973f48638 osu: add an experiment for Intel MPI tunning 2021-03-03 12:42:19 +01:00
Rodrigo Arias Mallo
4786953eeb garlic: fix self/super with correct scope 
The callPackage function was trying to find packages in bsc.self before
the self of the input parameters.
 2021-03-03 12:42:19 +01:00
Rodrigo Arias Mallo
a6815dc7cf fig: add article figure directory 2021-03-03 12:41:31 +01:00
Rodrigo Arias Mallo
4ffb609261 osu: add figures using the fast generators 2021-03-01 12:21:10 +01:00
Rodrigo Arias Mallo
1d015c7e1e ds: add osu fast generators 2021-03-01 12:00:58 +01:00
Rodrigo Arias Mallo
ed932c9921 osu: add bw test 2021-03-01 11:58:23 +01:00
Rodrigo Arias Mallo
a36d912022 osu: add multithread benchmark 2021-03-01 11:55:13 +01:00
Rodrigo Arias Mallo
8373751f67 rplot: remove suffix from input link 
We may have compressed input datasets
 2021-03-01 11:41:28 +01:00
Rodrigo Arias Mallo
2f7032aca6 pp: remove unused derivations and helpers 2021-03-01 11:40:56 +01:00
Rodrigo Arias Mallo
6dd41fd96f fig: use the fast timetable generator by default 2021-03-01 11:38:28 +01:00
Rodrigo Arias Mallo
09a0348b0e ds: add fast timetable generator 2021-03-01 11:16:03 +01:00
Rodrigo Arias Mallo
051a74b85d srun: allow commands to run before srun 2021-02-26 17:00:09 +01:00
Rodrigo Arias Mallo
8a77900201 srun: don't expand variables on install 2021-02-26 16:59:29 +01:00
Rodrigo Arias Mallo
1291b90b7f user guide: correct typo 2021-02-26 12:18:50 +01:00
Rodrigo Arias Mallo
8e130604aa machines: set the hardware revision for MN4 
This change will cause a rebuild of all experiments.
 2021-02-25 20:45:20 +01:00
Rodrigo Arias Mallo
0015c7e4cd pp: remove launcher 
It has now been integrated with resultTree in pp/store.nix
 2021-02-25 12:29:12 +01:00
Rodrigo Arias Mallo
9612c69aec doc: add garlic configuration section 
Update the garlicd usage as well.
 2021-02-25 11:38:29 +01:00
Rodrigo Arias Mallo
6e0e2f0bf6 garlicd: drop bscpkgs argument requirement 
The bscpkgs/default.nix is not longer read, as the garlic tool only
needs it for the fetching (-F), when it runs nix-build.
 2021-02-25 11:38:29 +01:00
Rodrigo Arias Mallo
48820ee2d3 resultTree: garlic must be used from the nix shell 2021-02-25 11:38:29 +01:00
Rodrigo Arias Mallo
9277e60079 timetable: enable verbose processing 2021-02-25 11:38:29 +01:00
Rodrigo Arias Mallo
c869b6e3b4 garlic: enable verbose rsync fetch 2021-02-25 11:38:29 +01:00
Rodrigo Arias Mallo
0b95ea20b7 garlicd: allow manual experiment executions 2021-02-25 11:37:58 +01:00
Rodrigo Arias Mallo
ceb25e5d18 osu: add figure for latency tests 2021-02-23 17:52:48 +01:00
Rodrigo Arias Mallo
0c9e89dcc0 osu: update experiments using stdexp 2021-02-23 15:22:56 +01:00
Rodrigo Arias Mallo
ebcbf91fbe exec: allow manual specification of program path 2021-02-23 15:22:18 +01:00
Rodrigo Arias Mallo
3e2b369e3e garlicd: allow nix builders write to the pipes 2021-02-17 10:28:34 +01:00
Rodrigo Arias Mallo
d4947a40b9 Fix ssh missing shell 2021-02-17 10:28:11 +01:00
Rodrigo Arias Mallo
243d022620 cn6: update name and add to the shell 2021-02-15 17:44:20 +01:00
Rodrigo Arias Mallo
0ee2747215 garlicd: avoid no match fail 
We check the result in the next if.
 2021-02-15 16:32:06 +01:00
Rodrigo Arias Mallo
5fd2a62684 doc: update garlicd usage from the nix-shell 2021-02-15 16:22:45 +01:00
Rodrigo Arias Mallo
0e0bf9e7a7 garlic: add shell with the garlic tools 2021-02-15 16:22:06 +01:00
Rodrigo Arias Mallo
cb5bcd7097 garlicd: add to index and check for error 
The garlicd is now available under garlic.garlid and it requires the
extra-sandbox-path option to be properly set.
 2021-02-15 16:20:06 +01:00
Rodrigo Arias Mallo
d51fe5db48 garlic tool: ensure the mountpoint is enabled 2021-02-15 16:18:21 +01:00
Rodrigo Arias Mallo
c36b724e9a Add experimental garlicd doc 2021-02-15 13:00:19 +01:00
Rodrigo Arias Mallo
cdf48181e5 user guide: add time measurement sections 2021-02-08 19:05:46 +01:00
Rodrigo Arias Mallo
a6b7b14d5e user guide: add initialization time limit 2021-02-08 19:05:46 +01:00
Rodrigo Arias Mallo
2ca58c46b4 user guide: Add postprocessing section 2021-02-08 19:05:46 +01:00
Rodrigo Arias Mallo
25208a8158 user guide: add tar.gz target for the web 2021-02-08 19:05:19 +01:00
Rodrigo Arias Mallo
c46feb4bf2 user guide: use ms macros 
Added HTML output
 2021-02-08 19:05:19 +01:00
Rodrigo Arias Mallo
4d626bff97 user guide: test ms macros 2021-02-08 19:05:19 +01:00
Rodrigo Arias Mallo
042876a287 user guide: generate html with css 2021-02-08 19:05:19 +01:00
Rodrigo Arias Mallo
edd71815eb pp: fix code block for html 2021-02-08 19:05:19 +01:00
Rodrigo Arias Mallo
39c360b413 user guide: add readme and branch name conventions 2021-02-08 19:04:51 +01:00
Rodrigo Arias Mallo
3ce0d3934b user guide: reorder development 2021-02-08 19:04:45 +01:00
Rodrigo Arias Mallo
60cab85fc4 user guide: expand the develop section 2021-02-08 19:04:36 +01:00
Rodrigo Arias Mallo
95809bd2bf user guide: add stub with mm macro 2021-02-08 19:04:30 +01:00
Rodrigo Arias Mallo
e5561b8735 control: save total execution time 2021-02-08 14:14:08 +01:00
Rodrigo Arias Mallo
d4dfbb7501 Remove garlic.ds attribute 
Datasets are now handled directly when creating the figures, via the
timetable attribute.
 2021-02-03 15:34:25 +01:00
Rodrigo Arias Mallo
b65a442cb0 fig: use timetable attribute in other plots 2021-02-03 15:34:10 +01:00
Rodrigo Arias Mallo
9c6b7a9f87 timetable: missing quote 2021-02-03 13:51:24 +01:00
Rodrigo Arias Mallo
d84ccf566b launcher: fix typo 2021-02-03 13:51:04 +01:00
Rodrigo Arias Mallo
0faf22a43f fig: add nbody example using timetable attribute 2021-02-03 13:07:55 +01:00
Rodrigo Arias Mallo
e89139284a stdexp: add result and timetable targets 
These targets allow one experiment to directly refer to another
experiment results, thus a dependency chain can be formed to ensure
execution order.

It also simplifies the dataset definition, as they can be automatically
fetched from the experiment directly.
 2021-02-03 12:37:54 +01:00