[Enhancement]: changing create_database to avoid targets present presents in both datapath and psflibpath to be duplicated.

[strampelligiovanni]

Instrument or Category

Other

What is your suggestion?

When using create_database, if a target is present presents in both datapath and psflibpath, it will be duplicated, instead of picking just one.
This is because when you provide datapath, you provide the path to a directory and it will read all the file in it like this:
datapaths = [os.path.join(input_dir, f) for f in fitsfiles]

Right now you can avoid this creating the database as follow:

    database = spaceKLIP.database.Database(output_dir=data_root)
    database.read_jwst_s012_data(datapaths=[i for i in glob(f'{data_root}/padded/{filename}*_calints.fits')],
                                 psflibpaths=[i for i in glob(f'{data_root}/psflib_offaxismasked/*_calints.fits')])

where here you can specify which data in datapath is SCI. Would be nice to have a similar behavior also for create_database.

Error traceback output

No response

What operating system are you using?

No response

What version of Python are you running?

No response

What Python packages do you have installed?

No response

[AarynnCarter]

Suggested solution is to raise a warning if a path is shared between datapaths and psflibpaths, as it will not be obvious if the user intended for a given file to be in one or the other.