idba hybrid assembly error
Hi,
I have been running the pipeline with my own test dataset. It runs fine up until the idba step and it produces this error:
14 of 58 steps (24%) done rule idba_hybrid_assembly_1: input: Preprocessing/mg.r1.preprocessed.fq, Preprocessing/mg.r2.preprocessed.fq, Preprocessing/mg.se.preprocessed.fq, Preprocessing/mt.r1.preprocessed.fq, Preprocessing/mt.r2.preprocessed.fq, Preprocessing/mt.se.preprocessed.fq, Assembly/mt.megahit_preprocessed.1/final.contigs.fa, Assembly/mt.megahit_unmapped.2/final.contigs.fa output: Assembly/mgmt.idba_hybrid.1.fa [x] Performing first hyrbid assembly step using IDBA [x] Interleave MG and MT fastq files [x] Join MG and MT interleaved fasta files [x] Concatenate MT contigs, MT and MG single end files number of threads 4 reads 60039998 long reads 35534055 extra reads 0 read_length 83 kmer 62 bash: line 14: 9630 Killed idba_ud -r $TMPD/merged.fa -l $TMPD/MT_contigs-MG_MT.SE.fa -o $TMPD --mink 25 --maxk 99 --step 4 --num_threads 4 --similar 0.98 --pre_correction Error in job idba_hybrid_assembly_1 while creating output file Assembly/mgmt.idba_hybrid.1.fa. RuleException: CalledProcessError in line 16 of /home/imp/code/rules/Assembly/hybrid/idba.hybrid.rules: Command ' echo "[x] Performing first hyrbid assembly step using IDBA"
echo "[x] Interleave MG and MT fastq files"
TMPD=$(mktemp -d -t --tmpdir=/home/imp/output/tmp "XXXXXX")
fq2fa --merge Preprocessing/mg.r1.preprocessed.fq Preprocessing/mg.r2.preprocessed.fq $TMPD/merged_MG.fa
fq2fa --merge Preprocessing/mt.r1.preprocessed.fq Preprocessing/mt.r2.preprocessed.fq $TMPD/merged_MT.fa
echo "[x] Join MG and MT interleaved fasta files"
cat $TMPD/merged_MG.fa $TMPD/merged_MT.fa > $TMPD/merged.fa
echo "[x] Concatenate MT contigs, MT and MG single end files"
cat <(cat Assembly/mt.megahit_preprocessed.1/final.contigs.fa Assembly/mt.megahit_unmapped.2/final.contigs.fa | awk '/^>/{print ">contig_MT_" ++i; next}{print}') <(cat Preprocessing/mg.se.preprocessed.fq | sed -n '1~4s/^@/>/p;2~4p') <(cat Preprocessing/mt.se.preprocessed.fq | sed -n '1~4s/^@/>/p;2~4p') > $TMPD/MT_contigs-MG_MT.SE.fa
idba_ud -r $TMPD/merged.fa -l $TMPD/MT_contigs-MG_MT.SE.fa -o $TMPD --mink 25 --maxk 99 --step 4 --num_threads 4 --similar 0.98 --pre_correction
mv $TMPD/contig.fa Assembly/mgmt.idba_hybrid.1.fa
rm -rf $TMPD
' returned non-zero exit status 137
File "/home/imp/code/rules/Assembly/hybrid/idba.hybrid.rules", line 16, in __rule_idba_hybrid_assembly_1 File "/usr/lib/python3.4/concurrent/futures/thread.py", line 54, in run Will exit after finishing currently running jobs. /home/imp/data/1D_S64_L006_R1_001.fastq => Preprocessing/mg.r1.fq /home/imp/data/1D_S64_L006_R2_001.fastq => Preprocessing/mg.r2.fq /home/imp/data/4_1D_S4_L001_R1_001.fastq => Preprocessing/mt.r1.fq /home/imp/data/4_1D_S4_L001_R2_001.fastq => Preprocessing/mt.r2.fq Exiting because a job execution failed. Look above for error message
Any ideas on how to rectify? A