Skip to content

大佬们求助!我换了个元数据集,运行失败问题 #2

@kiki-zhq

Description

@kiki-zhq

各位大佬,我又来了,基于之前篇章,我跑起来数据结果,但我这边上网找了别的样例数据跑,又跑不起来了。

一. 问题:
1、我现在通过检查命令是没问题的,但现在跑不起来,而且查看日志时候,trimming.txt会提示我:java.lang.RuntimeException: Invalid FASTQ name line: 错误

Using PrefixPair: 'TACACTCTTTCCCTACACGACGCTCTTCCGATCT' and 'GTGACTGGAGTTCAGACGTGTGCTCTTCCGATCT'
Using PrefixPair: 'TACACTCTTTCCCTACACGACGCTCTTCCGATCT' and 'GTGACTGGAGTTCAGACGTGTGCTCTTCCGATCT'
Using PrefixPair: 'TACACTCTTTCCCTACACGACGCTCTTCCGATCT' and 'GTGACTGGAGTTCAGACGTGTGCTCTTCCGATCT'
Using PrefixPair: 'TACACTCTTTCCCTACACGACGCTCTTCCGATCT' and 'GTGACTGGAGTTCAGACGTGTGCTCTTCCGATCT'
Using PrefixPair: 'TACACTCTTTCCCTACACGACGCTCTTCCGATCT' and 'GTGACTGGAGTTCAGACGTGTGCTCTTCCGATCT'
Using PrefixPair: 'TACACTCTTTCCCTACACGACGCTCTTCCGATCT' and 'GTGACTGGAGTTCAGACGTGTGCTCTTCCGATCT'
Using PrefixPair: 'TACACTCTTTCCCTACACGACGCTCTTCCGATCT' and 'GTGACTGGAGTTCAGACGTGTGCTCTTCCGATCT'
Using PrefixPair: 'TACACTCTTTCCCTACACGACGCTCTTCCGATCT' and 'GTGACTGGAGTTCAGACGTGTGCTCTTCCGATCT'
ILLUMINACLIP: Using 1 prefix pairs, 0 forward/reverse sequences, 0 forward only sequences, 0 reverse only sequences
ILLUMINACLIP: Using 1 prefix pairs, 0 forward/reverse sequences, 0 forward only sequences, 0 reverse only sequences
ILLUMINACLIP: Using 1 prefix pairs, 0 forward/reverse sequences, 0 forward only sequences, 0 reverse only sequences
ILLUMINACLIP: Using 1 prefix pairs, 0 forward/reverse sequences, 0 forward only sequences, 0 reverse only sequences
ILLUMINACLIP: Using 1 prefix pairs, 0 forward/reverse sequences, 0 forward only sequences, 0 reverse only sequences
ILLUMINACLIP: Using 1 prefix pairs, 0 forward/reverse sequences, 0 forward only sequences, 0 reverse only sequences
ILLUMINACLIP: Using 1 prefix pairs, 0 forward/reverse sequences, 0 forward only sequences, 0 reverse only sequences
ILLUMINACLIP: Using 1 prefix pairs, 0 forward/reverse sequences, 0 forward only sequences, 0 reverse only sequences
Exception in thread "main" Exception in thread "main" Exception in thread "main" Exception in thread "main" Exception in thread "main" Exception in thread "main" Exception in thread "main" Exception in thread "main" java.lang.RuntimeException: Invalid FASTQ name line: F3D8S196_1.fastq 0000755 0000000 0000000 00013255631 15035640755 012120 0 ustar root root @M00967:43:000000000-A3JHG:1:1101:17304:1428 1:N:0:196
java.lang.RuntimeException: Invalid FASTQ name line: F3D2S190_1.fastq 0000755 0000000 0000000 00052014627 15035640754 012104 0 ustar root root @M00967:43:000000000-A3JHG:1:1101:17046:1548 1:N:0:190
at org.usadellab.trimmomatic.fastq.FastqParser.parseOne(FastqParser.java:68)
java.lang.RuntimeException: Invalid FASTQ name line: F3D5S193_1.fastq 0000755 0000000 0000000 00011415767 15035640754 012117 0 ustar root root @M00967:43:000000000-A3JHG:1:1101:9945:2661 1:N:0:193
java.lang.RuntimeException: Invalid FASTQ name line: F3D6S194_1.fastq 0000755 0000000 0000000 00021071302 15035640754 012101 0 ustar root root @M00967:43:000000000-A3JHG:1:1101:16193:1426 1:N:0:194
java.lang.RuntimeException: Invalid FASTQ name line: F3D0S188_1.fastq 0000755 0000000 0000000 00020542010 15035640752 012072 0 ustar root root @M00967:43:000000000-A3JHG:1:1101:18327:1699 1:N:0:188
at org.usadellab.trimmomatic.fastq.FastqParser.parseOne(FastqParser.java:68)
java.lang.RuntimeException: Invalid FASTQ name line: F3D7S195_1.fastq 0000755 0000000 0000000 00012770747 15035640754 012126 0 ustar root root @M00967:43:000000000-A3JHG:1:1101:18321:2202 1:N:0:195
java.lang.RuntimeException: Invalid FASTQ name line: F3D1S189_1.fastq 0000755 0000000 0000000 00014444103 15035640753 012104 0 ustar root root @M00967:43:000000000-A3JHG:1:1101:18954:2112 1:N:0:189
java.lang.RuntimeException: Invalid FASTQ name line: F3D3S191_1.fastq 0000755 0000000 0000000 00016363420 15035640754 012104 0 ustar root root @M00967:43:000000000-A3JHG:1:1101:18489:1989 1:N:0:191
at org.usadellab.trimmomatic.fastq.FastqParser.parseOne(FastqParser.java:68)
at org.usadellab.trimmomatic.fastq.FastqParser.parseOne(FastqParser.java:68)
at org.usadellab.trimmomatic.fastq.FastqParser.parse(FastqParser.java:164)
at org.usadellab.trimmomatic.fastq.FastqParser.parseOne(FastqParser.java:68)
at org.usadellab.trimmomatic.fastq.FastqParser.parseOne(FastqParser.java:68)
at org.usadellab.trimmomatic.fastq.FastqParser.parse(FastqParser.java:164)
at org.usadellab.trimmomatic.fastq.FastqParser.parseOne(FastqParser.java:68)
at org.usadellab.trimmomatic.fastq.FastqParser.parseOne(FastqParser.java:68)
at org.usadellab.trimmomatic.fastq.FastqParser.parse(FastqParser.java:164)
at org.usadellab.trimmomatic.fastq.FastqParser.parse(FastqParser.java:164)
at org.usadellab.trimmomatic.TrimmomaticPE.process(TrimmomaticPE.java:265)
at org.usadellab.trimmomatic.fastq.FastqParser.parse(FastqParser.java:164)
at org.usadellab.trimmomatic.fastq.FastqParser.parse(FastqParser.java:164)
at org.usadellab.trimmomatic.TrimmomaticPE.process(TrimmomaticPE.java:265)
at org.usadellab.trimmomatic.fastq.FastqParser.parse(FastqParser.java:164)
at org.usadellab.trimmomatic.fastq.FastqParser.parse(FastqParser.java:164)
at org.usadellab.trimmomatic.TrimmomaticPE.process(TrimmomaticPE.java:265)
at org.usadellab.trimmomatic.TrimmomaticPE.process(TrimmomaticPE.java:265)
at org.usadellab.trimmomatic.TrimmomaticPE.run(TrimmomaticPE.java:555)
at org.usadellab.trimmomatic.TrimmomaticPE.process(TrimmomaticPE.java:265)
at org.usadellab.trimmomatic.TrimmomaticPE.process(TrimmomaticPE.java:265)
at org.usadellab.trimmomatic.TrimmomaticPE.run(TrimmomaticPE.java:555)
at org.usadellab.trimmomatic.TrimmomaticPE.process(TrimmomaticPE.java:265)
at org.usadellab.trimmomatic.TrimmomaticPE.process(TrimmomaticPE.java:265)
at org.usadellab.trimmomatic.TrimmomaticPE.run(TrimmomaticPE.java:555)
at org.usadellab.trimmomatic.TrimmomaticPE.run(TrimmomaticPE.java:555)
at org.usadellab.trimmomatic.Trimmomatic.main(Trimmomatic.java:80)
at org.usadellab.trimmomatic.TrimmomaticPE.run(TrimmomaticPE.java:555)
at org.usadellab.trimmomatic.TrimmomaticPE.run(TrimmomaticPE.java:555)
at org.usadellab.trimmomatic.Trimmomatic.main(Trimmomatic.java:80)
at org.usadellab.trimmomatic.TrimmomaticPE.run(TrimmomaticPE.java:555)
at org.usadellab.trimmomatic.TrimmomaticPE.run(TrimmomaticPE.java:555)
at org.usadellab.trimmomatic.Trimmomatic.main(Trimmomatic.java:80)
at org.usadellab.trimmomatic.Trimmomatic.main(Trimmomatic.java:80)
at org.usadellab.trimmomatic.Trimmomatic.main(Trimmomatic.java:80)
at org.usadellab.trimmomatic.Trimmomatic.main(Trimmomatic.java:80)
at org.usadellab.trimmomatic.Trimmomatic.main(Trimmomatic.java:80)
at org.usadellab.trimmomatic.Trimmomatic.main(Trimmomatic.java:80)
cat: /opt/dex-seq/template/data_analysis/trimming/reads/F3D6S194_1.fastqcat: /opt/dex-seq/template/data_analysis/trimming/reads/F3D3S191_1.fastqcat: /opt/dex-seq/template/data_analysis/trimming/reads/F3D2S190_1.fastqcat: /opt/dex-seq/template/data_analysis/trimming/reads/F3D7S195_1.fastqcat: /opt/dex-seq/template/data_analysis/trimming/reads/F3D0S188_1.fastqcat: /opt/dex-seq/template/data_analysis/trimming/reads/F3D5S193_1.fastq: No such file or directory: No such file or directory: No such file or directory
: No such file or directory
: No such file or directory
: No such file or directory

2、关于mapping_file.txt文件映射关系,我是参考样例去配置的,但我还是有点懵,key、value可否讲一下具体含义,我看文档写的比较模棱两可,可否给出示例出来?
3、我的数据集是否有问题,或者说是选择数据库不对,导致出不来结果?

二. 项目环境

1、路径:/opt/dex-seq/template
2、raw_data文件命名

F3D0S188_1.fastq.gz
F3D0S188_2.fastq.gz
F3D141S207_1.fastq.gz
F3D141S207_2.fastq.gz
F3D142S208_1.fastq.gz
F3D142S208_2.fastq.gz
F3D143S209_1.fastq.gz
F3D143S209_2.fastq.gz
F3D144S210_1.fastq.gz
F3D144S210_2.fastq.gz
F3D145S211_1.fastq.gz
F3D145S211_2.fastq.gz
F3D146S212_1.fastq.gz
F3D146S212_2.fastq.gz
F3D147S213_1.fastq.gz
F3D147S213_2.fastq.gz
F3D148S214_1.fastq.gz
F3D148S214_2.fastq.gz
F3D149S215_1.fastq.gz
F3D149S215_2.fastq.gz
F3D150S216_1.fastq.gz
F3D150S216_2.fastq.gz
F3D1S189_1.fastq.gz
F3D1S189_2.fastq.gz
F3D2S190_1.fastq.gz
F3D2S190_2.fastq.gz
F3D3S191_1.fastq.gz
F3D3S191_2.fastq.gz
F3D5S193_1.fastq.gz
F3D5S193_2.fastq.gz
F3D6S194_1.fastq.gz
F3D6S194_2.fastq.gz
F3D7S195_1.fastq.gz
F3D7S195_2.fastq.gz
F3D8S196_1.fastq.gz
F3D8S196_2.fastq.gz
F3D9S197_1.fastq.gz
F3D9S197_2.fastq.gz

3、 mapping_file.txt文件映射关系

F3D0S188 F3D
F3D1S189 F3D
F3D2S190 F3D
F3D3S191 F3D
F3D5S193 F3D
F3D6S194 F3D
F3D7S195 F3D
F3D8S196 F3D
F3D9S197 F3D
F3D141S207 F3D
F3D142S208 F3D
F3D143S209 F3D
F3D144S210 F3D
F3D145S211 F3D
F3D146S212 F3D
F3D147S213 F3D
F3D148S214 F3D
F3D149S215 F3D
F3D150S216 F3D

4、执行命令:apptainer exec -B /opt/dex-seq/db /opt/dex-seq/apptainer/dix-seq-1.0.0.sif dix-seq /opt/dex-seq/template/metadata.txt validate

metadata:
[1]: check parameter available:
parameter:[project_home] [/opt/dex-seq/template/] PASS
parameter:[project_id] [data_analysis] PASS
parameter:[raw_data] [/opt/dex-seq/template/raw_data] PASS
parameter:[mapping_file] [/opt/dex-seq/template/mapping_file.txt] PASS
parameter:[cpus] [80] PASS
parameter:[parallel] [8] PASS
parameter:[threads] [6] PASS
parameter:[trim_param] [2:30:10 SLIDINGWINDOW:4:15 LEADING:3 TRAILING:3 MINLEN:36] PASS
parameter:[mergepairs_param] [-fastq_minmergelen 250 -fastq_maxmergelen 500 -fastq_maxdiffs 10 -fastq_pctid 90 -fastq_minovlen 16 -fastq_trunctail 2 -fastq_minlen 64] PASS
parameter:[search_pcr_param] [-fwdprimer GTGCCAGCMGCCGCGG -revprimer CCGTCAATTCMTTTRAGTTT -minamp 250 -maxamp 480] PASS
parameter:[db] [/opt/dex-seq/db] PASS
parameter:[maxee] [1] PASS
parameter:[unoise3_param] [-minsize 8] PASS
parameter:[reference] [rdp_16s_v18_sp] PASS
parameter:[sintax_cutoff] [0.8] PASS
parameter:[filter] [NONE] PASS
parameter:[tree] [distmx] PASS
parameter:[rarefaction] [500:500:50000] PASS
parameter:[text] [T] PASS
parameter:[pathway] [F] PASS
parameter:[vegdist] [bray] PASS
[2]: check path available:
parameter:[project_home] path:[/opt/dex-seq/template/] PASS
parameter:[raw_data] path:[/opt/dex-seq/template/raw_data] PASS
parameter:[mapping_file] path:[/opt/dex-seq/template/mapping_file.txt] PASS
[3]: check reads available:
F3D0S188: /opt/dex-seq/template/raw_data/F3D0S188_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D0S188_2.fastq.gz PASS
F3D1S189: /opt/dex-seq/template/raw_data/F3D1S189_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D1S189_2.fastq.gz PASS
F3D2S190: /opt/dex-seq/template/raw_data/F3D2S190_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D2S190_2.fastq.gz PASS
F3D3S191: /opt/dex-seq/template/raw_data/F3D3S191_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D3S191_2.fastq.gz PASS
F3D5S193: /opt/dex-seq/template/raw_data/F3D5S193_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D5S193_2.fastq.gz PASS
F3D6S194: /opt/dex-seq/template/raw_data/F3D6S194_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D6S194_2.fastq.gz PASS
F3D7S195: /opt/dex-seq/template/raw_data/F3D7S195_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D7S195_2.fastq.gz PASS
F3D8S196: /opt/dex-seq/template/raw_data/F3D8S196_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D8S196_2.fastq.gz PASS
F3D9S197: /opt/dex-seq/template/raw_data/F3D9S197_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D9S197_2.fastq.gz PASS
F3D141S207: /opt/dex-seq/template/raw_data/F3D141S207_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D141S207_2.fastq.gz PASS
F3D142S208: /opt/dex-seq/template/raw_data/F3D142S208_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D142S208_2.fastq.gz PASS
F3D143S209: /opt/dex-seq/template/raw_data/F3D143S209_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D143S209_2.fastq.gz PASS
F3D144S210: /opt/dex-seq/template/raw_data/F3D144S210_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D144S210_2.fastq.gz PASS
F3D145S211: /opt/dex-seq/template/raw_data/F3D145S211_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D145S211_2.fastq.gz PASS
F3D146S212: /opt/dex-seq/template/raw_data/F3D146S212_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D146S212_2.fastq.gz PASS
F3D147S213: /opt/dex-seq/template/raw_data/F3D147S213_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D147S213_2.fastq.gz PASS
F3D148S214: /opt/dex-seq/template/raw_data/F3D148S214_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D148S214_2.fastq.gz PASS
F3D149S215: /opt/dex-seq/template/raw_data/F3D149S215_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D149S215_2.fastq.gz PASS
F3D150S216: /opt/dex-seq/template/raw_data/F3D150S216_1.fastq.gz,/opt/dex-seq/template/raw_data/F3D150S216_2.fastq.gz PASS

三、相关日志:

logs.zip

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions