From fbaa5bbfe0eb3357946db3fb22321c2a7a787e66 Mon Sep 17 00:00:00 2001 From: Hsin-Fang Chiang Date: Fri, 3 Dec 2021 17:52:03 -0800 Subject: [PATCH 1/3] List DP0.2's catalog products --- dp02.tex | 21 +++++++++++++++++++++ 1 file changed, 21 insertions(+) diff --git a/dp02.tex b/dp02.tex index 468f5fe..f22bde4 100644 --- a/dp02.tex +++ b/dp02.tex @@ -111,3 +111,24 @@ \subsection{DP0.2 - processing} \label{sec:dp0.2} \citeds{RTN-013} provided the goals for this task. \citeds{DMTN-168} provides guidelines on how to use this system. +\subsection {Catalogs} +In DP0.2, Science Pipelines reprocessed outputs include a number of catalogs +as parquet data products. +The parquet tables will be accessible as Butler datasets along with other DP0.2 data products, and their contents will be ingested in Qserv and made availble through TAP. +The Butler dataset names of these tables are the following: +\begin{enumerate} + \item \texttt{objectTable\_tract} + \item \texttt{sourceTable\_visit} + \item \texttt{forcedSourceTable} + \item \texttt{diaObjectTable\_tract} + \item \texttt{diaSourceTable\_tract} + \item \texttt{forcedSourceOnDiaObjectTable\_tract} +\end{enumerate} + +There will also be parquet data products \texttt{visitTable} and \texttt{ccdVisitTable} in the Butler repo, but it is not decided yet whether they will be ingested in Qserv and made availble through TAP. + +The following two tables from DP0.1 will be made available in DP0.2: +\begin{enumerate} + \item \texttt{dp01\_dc2\_catalogs.truth\_match} + \item \texttt{dp01\_dc2\_catalogs.object} +\end{enumerate} From 2115751646ce7ea68483a2c1523dff27b059cbdb Mon Sep 17 00:00:00 2001 From: Hsin-Fang Chiang Date: Mon, 6 Dec 2021 10:45:24 -0800 Subject: [PATCH 2/3] Provide the entire DP0.1 datalog in DP0.2 too --- dp01.tex | 2 +- dp02.tex | 7 ++----- 2 files changed, 3 insertions(+), 6 deletions(-) diff --git a/dp01.tex b/dp01.tex index 0bb4266..65d62eb 100644 --- a/dp01.tex +++ b/dp01.tex @@ -27,7 +27,7 @@ \subsection{Elements of Data Preview 0.1} \label{sec:dp0.1} -\subsubsection{Data Products Offered} +\subsubsection{Data Products Offered} \label{sec:dp01products} We will offer access to images and catalogs, though in more limited ways that will be available in Operations. Images will be stored in read-only Butler Gen3 repo. diff --git a/dp02.tex b/dp02.tex index f22bde4..e52e2d2 100644 --- a/dp02.tex +++ b/dp02.tex @@ -127,8 +127,5 @@ \subsection{DP0.2 - processing} \label{sec:dp0.2} There will also be parquet data products \texttt{visitTable} and \texttt{ccdVisitTable} in the Butler repo, but it is not decided yet whether they will be ingested in Qserv and made availble through TAP. -The following two tables from DP0.1 will be made available in DP0.2: -\begin{enumerate} - \item \texttt{dp01\_dc2\_catalogs.truth\_match} - \item \texttt{dp01\_dc2\_catalogs.object} -\end{enumerate} +All five tables from DP0.1 will be retained and made available in DP0.2 +(the \texttt{dp01\_dc2\_catalogs} database; \secref{sec:dp01products}). From 19ecd2a5582e767bfe4854391edbf56f7f0a385a Mon Sep 17 00:00:00 2001 From: Hsin-Fang Chiang Date: Wed, 8 Dec 2021 14:49:00 -0800 Subject: [PATCH 3/3] Promise a new truth match table for DP0.2 --- dp02.tex | 2 ++ 1 file changed, 2 insertions(+) diff --git a/dp02.tex b/dp02.tex index e52e2d2..e37469b 100644 --- a/dp02.tex +++ b/dp02.tex @@ -129,3 +129,5 @@ \subsection{DP0.2 - processing} \label{sec:dp0.2} All five tables from DP0.1 will be retained and made available in DP0.2 (the \texttt{dp01\_dc2\_catalogs} database; \secref{sec:dp01products}). + +We plan to add a new truth match table with DP0.2's object table and make it available in DP0.2; its format is not decided yet.