0 votes
112 views
Crossmatching with legacy survey data (I tried ls_dr7 and ls_dr8) using X-match service always timeout, even if the uploaded table only contains several hundred rows. I tried various tables and the result is always like this.
asked Nov 15, 2019 by Minghao | 112 views

1 Answer

0 votes
Hi Minghao,

thanks for reaching out. I just tried a crossmatch on our web x-match service, with 50 sources from the LS DR 7 footprint, against ls_dr7.tractor table; it worked fine (and very fast). Could you please provide more information, i.e. show here the first few rows (and the header line) of your own table, and tell which selections and options you have clicked in the web x-match service?

Thank you,

Robert
answered Nov 15, 2019 by robertdemo (300 points)
Hi Robert,

I don't know how to attach files in the reply, so the table might look messy. Here is the first few rows of my table:

objID,raStack,decStack,primaryDetection,bestDetection,mag_g_dered,mag_g_err,mag_r_dered,mag_r_err,mag_i_dered,mag_i_err,mag_z_dered,mag_z_err,mag_y_dered,mag_y_err,cntr_01,dist_x,pang_x,ra_01,dec_01,source_name,source_id,ra,dec,clon,clat,w1mpro,w1sigmpro,w2mpro,w2sigmpro,GroupID,GroupSize,Separation,Prob1,ra_epoch2000_g,dec_epoch2000_g,errHalfMaj_g,errHalfMin_g,errPosAng_g,source_id_g,ra_g,ra_error_g,dec_g,dec_error_g,parallax_g,parallax_error_g,pmra_g,pmra_error_g,pmdec_g,pmdec_error_g,duplicated_source_g,phot_g_mean_flux_g,phot_g_mean_flux_error_g,phot_g_mean_mag_g,phot_bp_mean_flux_g,phot_bp_mean_flux_error_g,phot_bp_mean_mag_g,phot_rp_mean_flux_g,phot_rp_mean_flux_error_g,phot_rp_mean_mag_g,bp_rp_g,radial_velocity_g,radial_velocity_error_g,rv_nb_transits_g,teff_val_g,a_g_val_g,e_bp_min_rp_val_g,radius_val_g,lum_val_g,angDist_g
167531145107002674,114.51079925,49.61003967,1,1,99.0,1.0857362047581294,17.897305161407104,0.0065104674953307224,16.052432899665806,0.0009185024887759149,16.02856680386683,0.002981055610946919,15.825076055173861,0.0036792743038937307,1854,1.358272,-81.827946,114.51079925,49.61003967,J073802.45+493636.3,1138p499_a1-000333,114.5102229,49.6100933,07h38m02.45s,49d36m36.34s,11.927,0.011,11.472,0.009,,,0.0,0.9358333333333333,114.5106801822283,49.609980796677,0.003000000026077032,0.0020000000949949026,90.0,982119691856816640,114.51068018223,2.7329,49.60998079668,1.8587,nan,nan,nan,nan,nan,nan,True,341.688,3.2597,19.354292,nan,nan,nan,nan,nan,nan,nan,nan,nan,0,nan,nan,nan,nan,nan,0.349383
156031263695188433,126.36953198,40.03151392,1,1,20.826380282540928,0.050432278153929117,18.490371817387047,0.006567035229601508,17.83476652906966,0.0031187356583999527,17.554889204319014,0.006761238349288006,17.462719707878236,0.017649399557957225,217933,1.285974,168.724248,126.36953198,40.03151392,J082528.71+400152.1,1258p393_a1-001327,126.3696232,40.0311636,08h25m28.71s,40d01m52.19s,13.563,0.015,13.146,0.012,,,0.0,0.9475,nan,nan,nan,nan,nan,,nan,nan,nan,nan,nan,nan,nan,nan,nan,nan,False,nan,nan,nan,nan,nan,nan,nan,nan,nan,nan,nan,nan,,nan,nan,nan,nan,nan,nan
119801309716348815,130.97169251,9.84028442,1,1,20.205874568018388,0.027333035197692042,19.502478284936657,0.015592366023065785,17.78125861152661,0.00401646847809578,17.544230481350496,0.006175237981948195,17.301867186156862,0.013308824769578037,424608,1.254088,-145.450437,130.97169251,9.84028442,J084353.15+095023.9,1302p090_a1-001714,130.971492,9.8399975,08h43m53.16s,09d50m23.99s,13.648,0.014,12.889,0.011,,,0.0,0.8560000000000002,130.9714027175047,9.8398953926019,0.014000000432133675,0.008999999612569809,90.0,598285542723503360,130.97139586902,0.4293,9.83989620191,0.2886,-0.6884,0.545,-1.567,0.899,0.188,0.572,False,311.482,1.41902,19.454782,331.057,12.3472,19.05163,502.582,10.8084,18.008904,1.042727,nan,nan,0,nan,nan,nan,nan,nan,1.737235
162331194138070886,119.41381697,45.27519992,1,1,19.2603410074564,0.011093659820858748,18.1043146988319,0.005767463561075876,17.44366913588844,0.002134936264206606,17.01792777039015,0.004235446950326637,16.796100129808973,0.0070342916152949025,492104,1.373013,21.283421,119.41381697,45.27519992,J075739.36+451631.9,1192p454_a1-001577,119.4140137,45.2755553,07h57m39.36s,45d16m32.00s,13.716,0.04,13.232,0.015,,,0.0,0.8519999999999999,nan,nan,nan,nan,nan,,nan,nan,nan,nan,nan,nan,nan,nan,nan,nan,False,nan,nan,nan,nan,nan,nan,nan,nan,nan,nan,nan,nan,,nan,nan,nan,nan,nan,nan

Here are the options that I selected for X-match:

Step 1: (table name); rastack; decstack; all.

Step 2: Data Table; ls_dr8; ls_dr8_tractor_n; ra; dec; all

Step 3: (file name); 3.6 arcsecond; find all matches; Download results to your computer only.

Thank you so much for your help!

Best regards,
Minghao
Hi Minghao,

thanks for the mini-table with 3 rows. I copied it to a file, uploaded, and then ran the x-match with your settings.. It worked. Would you mind sending your entire table? Just email it as an attachment to datalab@noao.edu, I'll take a look.

Robert
Hi Robert,

I have sent the table to datalab@noao.edu. After that, I tried several times with various tables, and they did not work. I found that the problem is not only about legacy survey; other tables in the database do not work as well.

Thanks for your help!

Minghao
Hi Robert,

I just did another test. The table only contains the coordinates of seven objects. Here is the csv file:

,rastack,decstack
0,0.01053248,8.76938619
1,0.04776155,26.50682276
2,0.05477845,1.37296978
3,0.05855646,6.54988508
4,0.07368364,7.89964492
5,0.07566661,14.52796944
6,0.09906404,17.78725731
7,0.11381061,10.668699400000001

and I matched it to ls_dr7.tractor, ls_dr8.tractor_s and ls_dr8.tractor_n catalog. It timed out at 300 sec for ls_dr7.tractor and ls_dr8.tractor_s, but worked for ls_dr8.tractor_n. I got really confused about this.

Minghao
Hi Minghao,

sorry it took a while... But the mistake was not in your data file, but in our mydb database config. This is fixed now and I was able to run your 1000-rows test CSV file very quickly with ls_dr8_tractor_n. Please give it a new go and let us know if you see any further problems. Thank you for you patience!

Robert
Hi Robert,

Thanks for your reply! I tried again and it works.

Minghao
--

190 questions

187 answers

168 comments

1,326 users

Welcome to Data Lab Help Desk, where you can ask questions and receive answers from other members of the community.