Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reading index catalog with URI fails #240

Closed
3 tasks done
camposandro opened this issue Mar 14, 2024 · 0 comments · Fixed by #244
Closed
3 tasks done

Reading index catalog with URI fails #240

camposandro opened this issue Mar 14, 2024 · 0 comments · Fixed by #244
Assignees
Labels
bug Something isn't working

Comments

@camposandro
Copy link
Contributor

Bug report

When trying to perform an index_search with a hipscat catalog source index loaded via HTTPS:

half_degree_surveys_path = "https://epyc.astro.washington.edu/~lincc-frameworks/half_degree_surveys"
ztf_source_object_index = hipscat.read_from_hipscat(f"{half_degree_surveys_path}/ztf/ztf_source_index")
index_search_df = ztf_source.index_search([object_id], ztf_source_object_index).compute()

ArrowInvalid: Expected a local filesystem path, got a URI: 'https://epyc.astro.washington.edu/~lincc-frameworks/other_degree_surveys/ztf/ztf_source_index/_metadata'

Opening this issue on the hipscat repository because it looks like at least some of the importer functionality is also not allowing URIs as input catalog paths. This in part stems for the fact that the is_valid_catalog method that checks the pointers for metadata files is considering the remote catalogs as invalid.

https://github.com/astronomy-commons/hipscat/blob/ece81e4f36967af38588f3310c565b4930fd057b/src/hipscat/io/validation.py#L6-L16

Before submitting
Please check the following:

  • I have described the situation in which the bug arose, including what code was executed, information about my environment, and any applicable data others will need to reproduce the problem.
  • I have included available evidence of the unexpected behavior (including error messages, screenshots, and/or plots) as well as a descriprion of what I expected instead.
  • If I have a solution in mind, I have provided an explanation and/or pseudocode and/or task list.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

2 participants