Skip to content

Missing Ground Truth Tables and Starmie Result Discrepancies #13

@MyriadVerse

Description

@MyriadVerse

Hi, I’m experiencing a couple of issues with your project, and I would appreciate your guidance to help clarify these points.

  1. Ground Truth Tables Missing:
    We have observed that the four operations—opendata union, opendata join, webtable union, and webtable join—are showing a significant number of ground truth tables that are not found in either the candidate tables or the query tables. The proportion of missing ground truth tables ranges from approximately 1% to 7%.

  2. Reproduction of Starmie Results:
    We are experiencing considerable differences between our results and those presented in the Starmie paper. To better understand these discrepancies, could you please provide the specific parameters used when running query.py? Additionally, we would like to confirm whether all query tables were included in the data lake during your Starmie runs, as many ground truth tables appear to be located in the query tables rather than in the data lake.

Thank you for your assistance in addressing these issues.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions