scTensor Experiments: Data Preparation and Reproduction

public public 1yr ago 0 bookmarks

scTensor-experiments

About data preparation

  • Synthetic datasets: synthetic_datasets/data/README.md

  • Real datasets: real_datasets/data/README.md

Requirements

  • Bash: GNU bash, version 4.2.46(1)-release (x86_64-redhat-linux-gnu)

  • Snakemake: 5.3.0

  • Singularity: 3.5.3

How to reproduce this workflow

snakemake -j 4 --use-singularity # Local Machine
snakemake -j 32 --cluster qsub --latency-wait 600 --use-singularity # Open Grid Engine
snakemake -j 32 --cluster sbatch --latency-wait 600 --use-singularity # Slurm

License

Copyright (c) 2020 Koki Tsuyuzaki and RIKEN Bioinformatics Research Unit Released under the Artistic License 2.0 .

Authors

  • Koki Tsuyuzaki

  • Manabu Ishii

  • Itoshi Nikaido

Code Snippets

62
63
shell:
    'src/preprocess_{wildcards.sample}.sh {output} > {log}'
76
77
shell:
    'src/groundtruth.sh {output} > {log}'
90
91
shell:
    'src/plot_groundtruth.sh {wildcards.sample} {output} > {log}'
107
108
shell:
    'src/labelpermutation.sh {input} {output.out1} {output.out2} > {log}'
124
125
shell:
    'src/labelpermutation2.sh {input} {output.out1} {output.out2} > {log}'
141
142
shell:
    'src/halpern.sh {input} {output.out1} {output.out2} > {log}'
158
159
shell:
    'src/cabelloaguilar.sh {input} {output.out1} {output.out2} > {log}'
175
176
shell:
    'src/previous_sctensor.sh {input} {output} > {log}'
192
193
shell:
    'src/sctensor.sh {input} {output} > {log}'
220
221
shell:
    'src/aggregate_previous_sctensor.sh {input} {output} > {log}'
236
237
shell:
    'src/aggregate_sctensor.sh {input} {output} > {log}'
266
267
shell:
    'src/roc_auc_bin_f.sh {input} {output} > {log}'
285
286
shell:
    'src/plot_roc_auc_f.sh {input} {output} > {log}'
305
306
shell:
    'src/plot_prc_aucpr_mcc.sh {input} {output} > {log}'
320
321
shell:
    'src/plot_auc.sh {output} > {log}'
335
336
shell:
    'src/plot_aucpr.sh {output} > {log}'
350
351
shell:
    'src/plot_f.sh {output} > {log}'
365
366
shell:
    'src/plot_mcc.sh {output} > {log}'
380
381
shell:
    'src/plot_fpr.sh {output} > {log}'
395
396
shell:
    'src/plot_fnr.sh {output} > {log}'
410
411
shell:
    'src/plot_pr.sh {output} > {log}'
425
426
shell:
    'src/plot_tr.sh {output} > {log}'
440
441
shell:
    'src/plot_time.sh {output} > {log}'
455
456
shell:
    'src/plot_memory.sh {output} > {log}'
478
479
shell:
    'src/plot_LR.sh {wildcards.binmethod} {wildcards.sample} {output} > {log}'
493
494
shell:
    'src/report.sh {input} {output} > {log}'
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/aggregate.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/aggregate.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/cabelloaguilar.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/groundtruth.R $@
Shell From line 11 of src/groundtruth.sh
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/halpern.R $@
Shell From line 11 of src/halpern.sh
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/labelpermutation2.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/labelpermutation.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_aucpr.R $@
Shell From line 11 of src/plot_aucpr.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_auc.R
Shell From line 11 of src/plot_auc.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_fnr.R
Shell From line 11 of src/plot_fnr.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_fpr.R
Shell From line 11 of src/plot_fpr.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_f.R
Shell From line 11 of src/plot_f.sh
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/plot_groundtruth.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/plot_LR.R $@
Shell From line 11 of src/plot_LR.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_mcc.R
Shell From line 11 of src/plot_mcc.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_memory.R
Shell From line 11 of src/plot_memory.sh
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/plot_prc_aucpr_mcc.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_pr.R
Shell From line 11 of src/plot_pr.sh
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/plot_roc_auc_f.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_time.R
Shell From line 11 of src/plot_time.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_tr.R
Shell From line 11 of src/plot_tr.sh
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/previous_sctensor.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/report.R $@
Shell From line 11 of src/report.sh
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/roc_auc_bin_f.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/sctensor.R $@
Shell From line 11 of src/sctensor.sh
114
115
shell:
    'src/cellcellsimulate.sh {wildcards.e} {output} > {log}'
126
127
shell:
    'src/groundtruth.sh {output} > {log}'
140
141
shell:
    'src/plot_groundtruth.sh {wildcards.sample} {output} > {log}'
161
162
shell:
    'src/{wildcards.othermethod}.sh {input} {output} > {log}'
179
180
shell:
    'src/previous_sctensor.sh {input} {output} > {log}'
197
198
shell:
    'src/sctensor.sh {input} {output} > {log}'
250
251
shell:
    'src/aggregate_previous_sctensor.sh {input} {output} > {log}'
264
265
shell:
    'src/aggregate_previous_sctensor.sh {input} {output} > {log}'
278
279
shell:
    'src/aggregate_previous_sctensor.sh {input} {output} > {log}'
292
293
shell:
    'src/aggregate_sctensor.sh {input} {output} > {log}'
306
307
shell:
    'src/aggregate_sctensor.sh {input} {output} > {log}'
320
321
shell:
    'src/aggregate_sctensor.sh {input} {output} > {log}'
354
355
shell:
    'src/roc_auc_bin_f.sh {input} {output} > {log}'
377
378
shell:
    'src/plot_roc_auc_f.sh {input.in1} {input.in2} {input.in3} {output} > {log}'
398
399
shell:
    'src/plot_prc_aucpr_mcc.sh {input.in1} {input.in2} {input.in3} {input.in4} {output} > {log}'
468
469
shell:
    'src/plot_auc.sh {wildcards.method} E2 {output} > {log}'
484
485
shell:
    'src/plot_auc_eachcci.sh {wildcards.method} E2 {output} > {log}'
499
500
shell:
    'src/plot_auc_merge.sh E2 {output} > {log}'
515
516
shell:
    'src/plot_auc.sh {wildcards.method} E5 {output} > {log}'
531
532
shell:
    'src/plot_auc_eachcci.sh {wildcards.method} E5 {output} > {log}'
546
547
shell:
    'src/plot_auc_merge.sh E5 {output} > {log}'
562
563
shell:
    'src/plot_auc.sh {wildcards.method} E10 {output} > {log}'
578
579
shell:
    'src/plot_auc_eachcci.sh {wildcards.method} E10 {output} > {log}'
593
594
shell:
    'src/plot_auc_merge.sh E10 {output} > {log}'
612
613
shell:
    'src/plot_aucpr.sh {wildcards.method} E2 {output} > {log}'
628
629
shell:
    'src/plot_aucpr_eachcci.sh {wildcards.method} E2 {output} > {log}'
643
644
shell:
    'src/plot_aucpr_merge.sh E2 {output} > {log}'
659
660
shell:
    'src/plot_aucpr.sh {wildcards.method} E5 {output} > {log}'
675
676
shell:
    'src/plot_aucpr_eachcci.sh {wildcards.method} E5 {output} > {log}'
690
691
shell:
    'src/plot_aucpr_merge.sh E5 {output} > {log}'
706
707
shell:
    'src/plot_aucpr.sh {wildcards.method} E10 {output} > {log}'
722
723
shell:
    'src/plot_aucpr_eachcci.sh {wildcards.method} E10 {output} > {log}'
737
738
shell:
    'src/plot_aucpr_merge.sh E10 {output} > {log}'
754
755
shell:
    'src/plot_f.sh {wildcards.binmethod} E2 {output} > {log}'
768
769
shell:
    'src/plot_f_eachcci.sh {wildcards.binmethod} E2 {output} > {log}'
783
784
shell:
    'src/plot_f_merge.sh E2 {output} > {log}'
797
798
shell:
    'src/plot_f.sh {wildcards.binmethod} E5 {output} > {log}'
811
812
shell:
    'src/plot_f_eachcci.sh {wildcards.binmethod} E5 {output} > {log}'
826
827
shell:
    'src/plot_f_merge.sh E5 {output} > {log}'
840
841
shell:
    'src/plot_f.sh {wildcards.binmethod} E10 {output} > {log}'
854
855
shell:
    'src/plot_f_eachcci.sh {wildcards.binmethod} E10 {output} > {log}'
869
870
shell:
    'src/plot_f_merge.sh E10 {output} > {log}'
886
887
shell:
    'src/plot_mcc.sh {wildcards.binmethod} E2 {output} > {log}'
900
901
shell:
    'src/plot_mcc_eachcci.sh {wildcards.binmethod} E2 {output} > {log}'
915
916
shell:
    'src/plot_mcc_merge.sh E2 {output} > {log}'
929
930
shell:
    'src/plot_mcc.sh {wildcards.binmethod} E5 {output} > {log}'
943
944
shell:
    'src/plot_mcc_eachcci.sh {wildcards.binmethod} E5 {output} > {log}'
958
959
shell:
    'src/plot_mcc_merge.sh E5 {output} > {log}'
972
973
shell:
    'src/plot_mcc.sh {wildcards.binmethod} E10 {output} > {log}'
986
987
shell:
    'src/plot_mcc_eachcci.sh {wildcards.binmethod} E10 {output} > {log}'
1001
1002
shell:
    'src/plot_mcc_merge.sh E10 {output} > {log}'
1018
1019
shell:
    'src/plot_fpr.sh {wildcards.binmethod} E2 {output} > {log}'
1032
1033
shell:
    'src/plot_fpr_eachcci.sh {wildcards.binmethod} E2 {output} > {log}'
1047
1048
shell:
    'src/plot_fpr_merge.sh E2 {output} > {log}'
1061
1062
shell:
    'src/plot_fpr.sh {wildcards.binmethod} E5 {output} > {log}'
1075
1076
shell:
    'src/plot_fpr_eachcci.sh {wildcards.binmethod} E5 {output} > {log}'
1090
1091
shell:
    'src/plot_fpr_merge.sh E5 {output} > {log}'
1104
1105
shell:
    'src/plot_fpr.sh {wildcards.binmethod} E10 {output} > {log}'
1118
1119
shell:
    'src/plot_fpr_eachcci.sh {wildcards.binmethod} E10 {output} > {log}'
1133
1134
shell:
    'src/plot_fpr_merge.sh E10 {output} > {log}'
1150
1151
shell:
    'src/plot_fnr.sh {wildcards.binmethod} E2 {output} > {log}'
1164
1165
shell:
    'src/plot_fnr_eachcci.sh {wildcards.binmethod} E2 {output} > {log}'
1179
1180
shell:
    'src/plot_fnr_merge.sh E2 {output} > {log}'
1193
1194
shell:
    'src/plot_fnr.sh {wildcards.binmethod} E5 {output} > {log}'
1207
1208
shell:
    'src/plot_fnr_eachcci.sh {wildcards.binmethod} E5 {output} > {log}'
1222
1223
shell:
    'src/plot_fnr_merge.sh E5 {output} > {log}'
1236
1237
shell:
    'src/plot_fnr.sh {wildcards.binmethod} E10 {output} > {log}'
1250
1251
shell:
    'src/plot_fnr_eachcci.sh {wildcards.binmethod} E10 {output} > {log}'
1265
1266
shell:
    'src/plot_fnr_merge.sh E10 {output} > {log}'
1282
1283
shell:
    'src/plot_pr.sh {wildcards.binmethod} E2 {output} > {log}'
1296
1297
shell:
    'src/plot_pr_eachcci.sh {wildcards.binmethod} E2 {output} > {log}'
1311
1312
shell:
    'src/plot_pr_merge.sh E2 {output} > {log}'
1325
1326
shell:
    'src/plot_pr.sh {wildcards.binmethod} E5 {output} > {log}'
1339
1340
shell:
    'src/plot_pr_eachcci.sh {wildcards.binmethod} E5 {output} > {log}'
1354
1355
shell:
    'src/plot_pr_merge.sh E5 {output} > {log}'
1368
1369
shell:
    'src/plot_pr.sh {wildcards.binmethod} E10 {output} > {log}'
1382
1383
shell:
    'src/plot_pr_eachcci.sh {wildcards.binmethod} E10 {output} > {log}'
1397
1398
shell:
    'src/plot_pr_merge.sh E10 {output} > {log}'
1415
1416
shell:
    'src/plot_tr.sh {output} > {log}'
1430
1431
shell:
    'src/plot_tr_eachcci.sh {output} > {log}'
1449
1450
shell:
    'src/plot_time.sh {wildcards.method} E2 {output} > {log}'
1464
1465
shell:
    'src/plot_time_merge.sh E2 {output} > {log}'
1480
1481
shell:
    'src/plot_time.sh {wildcards.method} E5 {output} > {log}'
1495
1496
shell:
    'src/plot_time_merge.sh E5 {output} > {log}'
1511
1512
shell:
    'src/plot_time.sh {wildcards.method} E10 {output} > {log}'
1526
1527
shell:
    'src/plot_time_merge.sh E10 {output} > {log}'
1545
1546
shell:
    'src/plot_memory.sh {wildcards.method} E2 {output} > {log}'
1560
1561
shell:
    'src/plot_memory_merge.sh E2 {output} > {log}'
1576
1577
shell:
    'src/plot_memory.sh {wildcards.method} E5 {output} > {log}'
1591
1592
shell:
    'src/plot_memory_merge.sh E5 {output} > {log}'
1607
1608
shell:
    'src/plot_memory.sh {wildcards.method} E10 {output} > {log}'
1622
1623
shell:
    'src/plot_memory_merge.sh E10 {output} > {log}'
1643
1644
shell:
    'src/plot_LR.sh {wildcards.binmethod} E2 {output} > {log}'
1661
1662
shell:
    'src/plot_LR.sh {wildcards.binmethod} E5 {output} > {log}'
1679
1680
shell:
    'src/plot_LR.sh {wildcards.binmethod} E10 {output} > {log}'
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/aggregate.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/aggregate.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/cellcellsimulate.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/groundtruth.R $@
Shell From line 11 of src/groundtruth.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_auc_eachcci.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_auc_merge.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_aucpr_eachcci.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_aucpr_merge.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_aucpr.R $@
Shell From line 11 of src/plot_aucpr.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_auc.R $@
Shell From line 11 of src/plot_auc.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_f_eachcci.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_f_merge.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_fnr_eachcci.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_fnr_merge.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_fnr.R $@
Shell From line 11 of src/plot_fnr.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_fpr_eachcci.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_fpr_merge.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_fpr.R $@
Shell From line 11 of src/plot_fpr.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_f.R $@
Shell From line 11 of src/plot_f.sh
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/plot_groundtruth.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/plot_LR.R $@
Shell From line 11 of src/plot_LR.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_mcc_eachcci.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_mcc_merge.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_mcc.R $@
Shell From line 11 of src/plot_mcc.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_memory_merge.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/plot_memory.R $@
Shell From line 11 of src/plot_memory.sh
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/plot_prc_aucpr_mcc.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_pr_eachcci.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_pr_merge.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_pr.R $@
Shell From line 11 of src/plot_pr.sh
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/plot_roc_auc_f.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_time_merge.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_time.R $@
Shell From line 11 of src/plot_time.sh
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_tr_eachcci.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/plot_tr.R $@
Shell From line 11 of src/plot_tr.sh
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/previous_sctensor.R $@
11
12
13
SLURM_RESTART_COUNT=2

Rscript src/roc_auc_bin_f.R $@
11
12
13
14
15
SLURM_RESTART_COUNT=2

echo $@

Rscript src/sctensor.R $@
Shell From line 11 of src/sctensor.sh
ShowHide 184 more snippets with no or duplicated tags.

Login to post a comment if you would like to share your experience with this workflow.

Do you know this workflow well? If so, you can request seller status , and start supporting this workflow.

Free

Created: 1yr ago
Updated: 1yr ago
Maitainers: public
URL: https://github.com/rikenbit/scTensor-experiments
Name: sctensor-experiments
Version: 1
Badge:
workflow icon

Insert copied code into your website to add a link to this workflow.

Downloaded: 0
Copyright: Public Domain
License: None
  • Future updates

Related Workflows

cellranger-snakemake-gke
snakemake workflow to run cellranger on a given bucket using gke.
A Snakemake workflow for running cellranger on a given bucket using Google Kubernetes Engine. The usage of this workflow ...