Skip to content

Add explicit checks for external tool dependencies (ffprobe, gsutil)#35

Open
ishaanxgupta wants to merge 2 commits intogoogle-deepmind:mainfrom
ishaanxgupta:ishaan/error
Open

Add explicit checks for external tool dependencies (ffprobe, gsutil)#35
ishaanxgupta wants to merge 2 commits intogoogle-deepmind:mainfrom
ishaanxgupta:ishaan/error

Conversation

@ishaanxgupta
Copy link
Copy Markdown
Contributor

@ishaanxgupta ishaanxgupta commented Jan 3, 2026

solves issue #31

This PR improves the robustness of the Physics-IQ benchmark by adding explicit validation for required external executables (ffprobe, gsutil) before they are invoked at runtime.

Currently, missing or PATH-inaccessible tools cause hard failures (e.g. FileNotFoundError) that are difficult to debug, particularly in non-root or managed environments. This change surfaces clear, actionable error messages instead.

Added a function to check for required executables and updated the download function to use it for gsutil.
Added a function to check for required executables and updated the ffprobe call to use this function.
@ishaanxgupta ishaanxgupta marked this pull request as ready for review January 6, 2026 13:56
@ved015
Copy link
Copy Markdown
Contributor

ved015 commented Jan 7, 2026

Hi @rgeirhos, looking forward to your review on this. Thanks!

@ishaanxgupta
Copy link
Copy Markdown
Contributor Author

@rgeirhos awaiting your review on this one

1 similar comment
@ishaanxgupta
Copy link
Copy Markdown
Contributor Author

@rgeirhos awaiting your review on this one

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants