close

Science within the HiPS ecosystem

Tutorial presented during ADASS XXXV, Sunday, November 9 2025, 15:30-17:00

Science within the HiPS ecosystem is a Tutorial presented in Görlitz (Germany), during ADASS XXXV, on Sunday, November 9 2025, 15:30-17:00. Room: Theater, Benigna.

Instructor: Sébastien Derriere (CDS). Tutors: Thomas Boch, Pierre Fernique, Matthieu Baumann (CDS)

Introduction

The main goal of this tutorial is to teach participants how to use hierarchical Virtual Observatory (VO) standards allowing construction, exploration and querying of all-sky datasets. The Hierarchical Progressive Survey (HiPS) and the Space-Time Multi-Order Coverage map (ST-MOC) standards can be used by data providers to expose their datasets (images or catalogues), and astronomers can use them to perform complex queries and operations on all-sky datasets.

Primary learning objectives

Requirements for participants

Please download the HiPS_Tutorial_data.zip (160MB) data samples before attending the tutorial !

The extracted HiPS_Tutorial_data directory will contain :

Test images and catalogues will also be available on USB sticks during the tutorial if needed.

Tutorial Plan

1. Introduction to the session, standards and tools

PDF introduction slides

Introduction to the Hierarchical Progressive Survey (HiPS) and the Space-Time Multi-Order Coverage map (ST-MOC) standards, what they are and what they enable for doing science.

Quick introduction to Aladin Desktop, Aladin Lite v3 and ipyaladin.

2. First manipulation of HiPS and MOC

2.1 With Aladin Desktop

Launch Aladin Desktop, by running the appropriate launcher, or executing:

java -Xmx2048m -Xms1024m -jar Aladin.jar

SDSS and GALEX in Aladin Desktop

HiPS enable a full-sky overview, but one can zoom to see the full-resolution images locally, without downloading the full dataset.

Make sure you compute only the spatial MOC : uncheck the Time checkbox

MOC intersection

Intersection of the SDSS and GALEX MOCs

One can use a MOC as a constraint, to find catalogue sources whose positions are located inside the MOC.

Select the VII/192 catalogue

Filter a catalogue by MOC

2.2 With a Python Notebook

The manipulation of the 2 MOCs and the filtering of the Arp’s peculiar galaxies can be done from a Python notebook, and visualized with ipyaladin.

Use this link to launch the notebook MOC_filtering.ipynb in Jupyter lite (in your browser, no installation needed).

If you know how to run Jupyter notebooks locally, you can download and run the following notebook: MOC_filtering.ipynb, a simplified version of this CDS tutorial.

3. Comet hunting in the DSS survey

This exercise shows the manipulation of space-time MOCs to find spatio-temporal coincidence of datasets. This is a new capability offered by the latest MOC standard.

Load DSS2 HiPS and progenitors

STMOC generation

Comet 47P identification

4. Creating your own image HiPS and MOC

In this section, we will present how to convert individual FITS images into an image HiPS survey, with the associated MOC.

4.1 HiPS and MOC creation

We take a sample of 6 Halpha images from the online data from Boselli et al. 2022 (catalogue J/A+A/659/A46 in VizieR), with different sizes, and convert them into a HiPS image survey.

The 6 FITS files are in the HiPS_Tutorial_data/images directory extracted from the HiPS_Tutorial_data.zip (160MB) data samples.

Method 1:

This can be done from the command line, with the input images in a directory named HiPS_Tutorial_data/images and the output HiPS created in a directory named hips:

java -jar Aladin.jar -hipsgen in=HiPS_Tutorial_data/images out=hips id=adassTutorial

Method 2:

This can also be processed interactively from Aladin Desktop : Tool > Generate a HiPS based on > An image collection

4.2 Visualisation and manipulation

Once the HiPS is processed, one can simply open the hips directory to visualize it in Aladin Desktop (use Ctrl+L to load a local directory). Generating a PNG or JPG version of the tiles provides a lighter version of the survey which can be displayed by Aladin Lite.

Aladin generates an hips/index.html landing HTML page for your custom HiPS, which you can try to open by starting a simple http server on your local machine with Python 3, running the following command in the directory where your HiPS is stored:

python -m http.server

This will return the corresponding URL, for example:

> Serving HTTP on 0.0.0.0 port 8000 (http://0.0.0.0:8000/)...

You can compare your custom HiPS with reference HiPS surveys such as GALEX.

In the directory, you will also find a MOC describing the spatial coverage of your dataset (Moc.fits file under the root of the HiPS directory).

4.3 Filtering a catalogue by MOC

4.3.1 With Aladin Desktop

Try to use this MOC to directly query the NGC 2000.0 catalogue from the VizieR collection (VII/118/ngc2000) for sources which are located inside the MOC using Aladin Desktop :

This NGC sample only contains 5 galaxies :

NGC 4429
NGC 4459
NGC 4469
NGC 4476
NGC 4526

4.3.2 In Python (optional : try it if you have time)

The catalogue query by MOC can also be performed from a Python notebook (adapted from Step 5 of this notebook).

Use this link to launch the notebook in Jupyter lite MOC_filtering2.ipynb (in your browser, no installation needed).

If you know how to run Jupyter notebooks locally, you can download and run the following notebook: MOC_filtering2.ipynb (adapted from Step 5 of this notebook).

5. HiPS catalogues

Images are not the only data products that can be accessed by hierarchical progressive surveys : it also works for large catalogues.

Manipulate a progressive catalogue

Create your own progressive catalogue

One can create a progressive catalogue using a different sorting, with the Hipsgen-cat tool. Detailed instructions on options are available here.

Take the Gaia DR3 source sample (GaiaDR3_votable.b64) provided in the tutorial material and generate from the command line a progressive version sorted by parallax, to be created in an output directory named GaiaDR3_hips :

java -jar Hipsgen-cat.jar -cat GaiaSample -in HiPS_Tutorial_data/GaiaDR3_votable.b64 -f VOT -ra RA_ICRS -dec DE_ICRS -n1 100 -n2 200 -nM 200 -lM 10 -score Plx -desc -out ./GaiaDR3_hips

Load your HiPS catalogue in Aladin Desktop (Ctrl+L and browse to the directory GaiaDR3_hips) and compare it to the progressive default Gaia DR3.

6. HiPS3D demonstration

The HiPS standard has been extended to enable easy manipulation of large data cubes. Aladin Desktop and Aladin Lite now support the visualization of HiPS3D datasets.

You can try it on the following datasets :

6.1 The Local Group L-Band Survey

The Local Group L-Band Survey is a Karl G. Jansky Very Large Array "extra large" survey of 21-cm , continuum, and OH emission from the Local Group of Galaxies.

Open in a new browser tab this page, displaying the LGLBS data around M31.

LGLBS in Aladin Lite

We can try to estimate the radial velocity of M31 from the data :

6.2 MUSE (optional : try it if you have time)

Open in a new browser tab this page, displaying test MUSE data.

7. Extraction of cutouts from HiPS surveys with hips2fits

7.1 Simple FITS extraction

The hips2fits service enables generation of FITS images cutouts of arbitrary size and resolution from a given HiPS. You can use it by filling a form on this web page, or using the API.

Galactic center as seen by Meerkat at 1284MHz

Aladin Lite v3 supports FITS images : load this FITS image into an instance of Aladin Lite and compare it to the other survey by changing the opacity. For example:

You can also use the overlays menu Overlays icon to load a local FITS file :

Loading a local FITS file

You can also change the colormap, pixel cuts and dynamics of your FITS image.

The hips2fits service can also be accessed in python with astroquery.hips2fits

7.2 List of thumbnails

From Aladin Desktop (optional : try it if you have time)

Aladin Desktop has an embedded tool to generate thumbnail views : Tool > Thumbnail view generator. It can create multi-views from a selection of targets for the current survey.

Use this tool to generate views for the NGC sample created in step 4.3.1, using the GALEX survey as a base image.

Aladin Desktop thumbnails for NGC sample

With hips2fits

You can use this online tool to generate a page with thumbnails, generated from the hips2fits service, for a list of targets (positions or object names) and a list of HiPS surveys.

Try to use this tool to generate a page with 0.1deg thumbnails for GALEX and SDSS images for our NGC sample (upload the list of names in ngc2000_sample.txt).

NGC 4429
NGC 4459
NGC 4469
NGC 4476
NGC 4526

hips2fits thumbnails

You could also use Python to script the extraction of thumbnails for a list of targets with astroquery.hips2fits.

8. Wrap-up and conclusion

Summary of what we’ve learned, perspectives of HiPS and MOC for 3D datasets.

Thanks !