slow file loading



On 8/22/11, ladida vllt <ladida.vllt at gmail.com> wrote:

> i have a huge matrix (saved in a file), and i want to load this file, but
> with the standard load-command this takes nearly 10 min; if i load it from a
> program (C#) it only takes a few seconds.
> how can i make the load-command faster?

If the matrix in question contains only floating point numbers,
you are probably better off using R or Octave or something like
that, which are stronger than Maxima for many numerical problems.

If you still want to use Maxima, you could load it once and
then save it as file of binary floats via write_binary_data.

If you are prepared to do some preprocessing to get the
original data to load faster, you could reformat (via awk or
sed or perl or whatever) the original data into Lisp
and then load that; it would be faster since the Lisp
parser is probably a lot faster than the Maxima parser.
I can help with that if you choose to go down that road.

What, exactly, is the content of the data file?
Perhaps you can show the first few lines.
And what command, exactly, are you using to load it?

best,

Robert Dodier