Issue with opening snapshot data (TNG100-1) with Julia
Bram Alferink
4 Jul
I have run into an issue (bug?) with the Julia code for opening snapshot data (happens for multiple different fields).
Here is an example where it goes wrong (note that the fields are large ~50GB).
import illustris_julia as il
basePath = "..../output"
dm_ids = il.snapshot.loadSubset(basePath, 99, "dm", ["ParticleIDs"]))
This results in this error:
ERROR: BoundsError: attempt to access 1733600704-element Vector{UInt64} at index [1724490498:1737847535]
Stacktrace:
[1] throw_boundserror(A::Vector{UInt64}, I::Tuple{UnitRange{Int64}})
@ Base ./essentials.jl:14
[2] checkbounds
@ ./abstractarray.jl:699 [inlined]
[3] setindex!(A::Vector{UInt64}, X::Vector{UInt64}, I::UnitRange{Int64})
@ Base ./array.jl:1024
[4] loadSubset(basePath::String, snapNum::Int64, partType::String, fields::Vector{String}, subset::Nothing)
@ illustris_julia.snapshot ~/.julia/packages/illustris_julia/uXxA7/src/snapshot.jl:147
[5] loadSubset(basePath::String, snapNum::Int64, partType::String, fields::Vector{String})
@ illustris_julia.snapshot ~/.julia/packages/illustris_julia/uXxA7/src/snapshot.jl:47
The same code in python does not have such an issue:
import illustris_python as il
basePath = "..../output"
dm_ids = il.snapshot.loadSubset(basePath, 99, "dm", ["ParticleIDs"])
I have successfully opened illustris3 fields with the same/similar Julia code before. Any idea what could be the issue? I have checked whether all the downloads went correctly which is also proven by the fact it does work using python.
I have run into an issue (bug?) with the Julia code for opening snapshot data (happens for multiple different fields).
Here is an example where it goes wrong (note that the fields are large ~50GB).
import illustris_julia as il
basePath = "..../output"
dm_ids = il.snapshot.loadSubset(basePath, 99, "dm", ["ParticleIDs"]))
This results in this error:
ERROR: BoundsError: attempt to access 1733600704-element Vector{UInt64} at index [1724490498:1737847535]
Stacktrace:
[1] throw_boundserror(A::Vector{UInt64}, I::Tuple{UnitRange{Int64}})
@ Base ./essentials.jl:14
[2] checkbounds
@ ./abstractarray.jl:699 [inlined]
[3] setindex!(A::Vector{UInt64}, X::Vector{UInt64}, I::UnitRange{Int64})
@ Base ./array.jl:1024
[4] loadSubset(basePath::String, snapNum::Int64, partType::String, fields::Vector{String}, subset::Nothing)
@ illustris_julia.snapshot ~/.julia/packages/illustris_julia/uXxA7/src/snapshot.jl:147
[5] loadSubset(basePath::String, snapNum::Int64, partType::String, fields::Vector{String})
@ illustris_julia.snapshot ~/.julia/packages/illustris_julia/uXxA7/src/snapshot.jl:47
The same code in python does not have such an issue:
import illustris_python as il
basePath = "..../output"
dm_ids = il.snapshot.loadSubset(basePath, 99, "dm", ["ParticleIDs"])
I have successfully opened illustris3 fields with the same/similar Julia code before. Any idea what could be the issue? I have checked whether all the downloads went correctly which is also proven by the fact it does work using python.
Best,
Bram