0 votes
28 views

Dear Helpdesk,

I recently downloaded the results from my recent queries (previous ticket titled NOIRLab Source Catalog 2 queries), however I am having issues uploading them to Topcat. I receive errors for both CSV files stating that the number of columns in a certain row is not what is expected. I have also tried reading in the file using pandas and converting to a FITS file, but again, I had issues. Below I paste the output of the CSV file as provided by pandas:

         class_star        dec    decerr       ebv  ...  uerr       umag      zerr       zmag

0          0.478638 -82.662062  0.069118  0.268144  ...  9.99  99.989998  0.082978  21.663576

1          0.491888 -82.652896  0.047888  0.268640  ...  9.99  99.989998  0.083381  21.426224

2          0.474276 -82.576721  0.035757  0.258849  ...  9.99  99.989998  0.055398  21.866787

3          0.353271 -82.574208  0.098755  0.258101  ...  9.99  99.989998  9.990000  99.989998

4          0.385010 -82.573974  0.142212  0.258050  ...  9.99  99.989998  0.143311  21.875000

...             ...        ...       ...       ...  ...   ...        ...       ...        ...

5065139    0.659098 -69.625553  0.041240  0.036952  ...  9.99  99.989998  9.990000  99.989998

5065140    0.486084 -69.625218  0.110046  0.036966  ...  9.99  99.989998  9.990000  99.989998

5065141    0.358347 -69.624309  0.071790  0.036978  ...  9.99  99.989998  0.147461  21.843750

5065142    0.656250 -69.623660  0.201050  0.036974  ...  9.99  99.989998  9.990000  99.989998

5065143    0.379883 -69.624129  0.097595       NaN  ...   NaN        NaN       NaN        NaN

As you can see there is an issue with the values after the 3rd column at line 506144. Is there any way you would be able to find out what the issue is here and help me download the data in full?

Regards,

Cameron

asked Nov 19, 2020 by cameronbell (140 points) | 28 views

1 Answer

0 votes
Hi Cameron, thanks for reaching out. I don't know how TOPCAT handles NaN values, but I suspect it depends on how they are encoded in your file (CSV) here. Same with Pandas. Would you mind sending a few lines of the failing CSV file to datalab@noirlab.edu ? Just make a new CSV file, with the same header line, and some lines around line 506144, exactly as they are in your current file.

Thanks,

Robert
answered Nov 25, 2020 by robertdemo (940 points)

217 questions

215 answers

218 comments

1,497 users

Welcome to Data Lab Help Desk, where you can ask questions and receive answers from other members of the community.