Can't find my saved models after succeeded run


#1

I have used a base code with an LDA unsupervised algorithm for text clustering and topic detection, then saved the model using " LdaModel.save(fname=“ldaModel_ko_500pass”) " by gensim module and I can’t find where my saved files for my model so I can download it to my local computer.

PS:
The code works well on my local computer and it saves the model on the current directory for the code.


#2

Hi @sharafcode

All data that needs to be persisted should be written to /output directory. After that, you can find them in experiment dashboard in jobs/{jobID}/output directory or download them by neptune data download command. See https://docs.neptune.ml/cli/neptune_data/ and https://docs.neptune.ml/cli/neptune_send/.


#3

@sharafcode,

See also https://docs.neptune.ml/advanced-topics/storage/
You can add --backup option to neptune send command to make any file or directory be saved in /experiments/{experimentId}/jobs/{jobId}/backup directory.


#4

@Wajcha
I have added backup to ‘neptune send’ and use --backup “/Checkpoints_training” to backup my saved parameters that I have saved it in this directory then after succeeded run, nothing found in the backup dir. !!! I don’t know where’s the error is it from my side or from the server side.


#5

@sharafcode,

Could you attach ID of your experiment?


#6

@Wajcha

ID :: c637b87e-a379-4fba-b620-e7b2327e81f2


#7

It looks like the command you performed was

neptune send --environment base-gpu --worker gcp-gpu-medium --input /uploads/KO_raw_withBODY.csv --backup main.py

instead of

neptune send --environment base-gpu --worker gcp-gpu-medium --input /uploads/KO_raw_withBODY.csv --backup /Checkpoints_training

and there actually is main.py file backuped. Could you verify if this is correct?


#8

@Wajcha
I have run another experiment with the comand neptune send --environment base-gpu --worker gcp-gpu-medium --input /uploads/KO_raw_withBODY.csv --backup /Checkpoints_training
, and still can’t find my saved files.


#9

@sharafcode,

It looks like neptune can’t find /Checkpoints_training file in a root directory.
Are you sure that your code creates /Checkpoints_training in a root dir (and that it starts with a capital C)? If an argument for --backup option starts with /, neptune will search for it in root dir. If your code creates it in a working directory you should skip a slash in a path.