2025-04-28-the-usefulness-ceiling by penfever · Pull Request #28 · iclr-blogposts/2025

penfever · 2024-11-12T16:43:11Z

No description provided.

busycalibrating · 2024-11-16T01:36:41Z

Hi, thanks for your submission! I believe we fixed our pipeline - could you please sync your fork to update the github actions files in your repository, and hopefully that should auto trigger the build process.

If you have any other issues, please consult our updated pull request checklist:

Checklist before opening a PR

I am opening a pull request against the main branch of the 2025 repo.

My post and all associated references to it are all lowercase, i.e

  2025-04-28-Sample-Test.md               -> 2025-04-28-sample-test.md
  assets/img/2025-04-28-Sample-Test/ 	  -> assets/img/2025-04-28-sample-test/

The title of my PR is exactly the name of my markdown file
- i.e. _posts/2025-04-28-[submission-name].md would require a PR name 2025-04-28-[submission-name]
I have anonymized my post: my author's list is Anonymous, and there is no potential
content which can reveal my/my collaborators identities.
My post matches the formatting requirements, including (but not limited to):
- I have ONLY MODIFIED files in the following locations (failure to do so will result in
  your PR automatically being closed!):
  - a Markdown (or HTML) file in _posts/ with the format _posts/2025-04-28-[submission-name].md (or .html)
  - static image assets added to assets/img/2025-04-28-[submission-name]/
  - interactive HTML figures added to assets/html/2025-04-28-[submission-name]/
  - citations in a bibtex file in assets/bibliography/2025-04-28-[submission-name].bib
- I have a short 2-3 sentence abstract in the description field of my front-matter
- I have a table of contents, formatted using the toc field of my front-matter
- My bibliography is correctly formatted, using a .bibtex file as per the sample post

Thanks a lot for your patience and please tag me if you need any more help!

…ling

github-actions · 2024-11-16T11:18:32Z

⚠️ We have detected a problem with your submission! ⚠️

Your PR title does not match the slug template, which is <2025-dd-dd-.+>. Also, you can only add/change/remove files related to your post, i.e. files that match one of these patterns: <_posts/SLUG.md, assets/img/SLUG/..., assets/html/SLUG/..., assets/bibliography/SLUG.bib>. But we found that you changed the following: <_posts/2025-04-28-The-Usefulness-Ceiling.md>. Also, make sure your PR's title (posts-2025-04-28-the-usefulness-ceiling) matches your post's slug!

Please make the aforementioned changes and re-submit :)

github-actions · 2024-11-16T11:24:19Z

⚠️ We have detected a problem with your submission! ⚠️

You can only add/change/remove files related to your post, i.e. files that match one of these patterns: <_posts/SLUG.md, assets/img/SLUG/..., assets/html/SLUG/..., assets/bibliography/SLUG.bib>. But we found that you changed the following: <_posts/2025-04-28-The-Usefulness-Ceiling.md>. Also, make sure your PR's title (2025-04-28-the-usefulness-ceiling) matches your post's slug!

Please make the aforementioned changes and re-submit :)

github-actions · 2024-11-16T11:26:43Z

⚠️ We have detected a problem with your submission! ⚠️

You can only add/change/remove files related to your post, i.e. files that match one of these patterns: <_posts/SLUG.md, assets/img/SLUG/..., assets/html/SLUG/..., assets/bibliography/SLUG.bib>. But we found that you changed the following: <_posts/2025-04-28-The-Usefulness-Ceiling.md>. Also, make sure your PR's title (2025-04-28-the-usefulness-ceiling) matches your post's slug!

Please make the aforementioned changes and re-submit :)

…ess-ceiling.md

github-actions · 2024-11-16T14:31:16Z

⚠️ We have detected a problem with your submission! ⚠️

Please make the aforementioned changes and re-submit :)

penfever · 2024-11-16T14:33:36Z

@busycalibrating, I was able to fix the naming issues, but the checks are still failing with a "broken pipe" error, can you take a look?

busycalibrating · 2024-11-16T14:40:25Z

Could you try removing the brackets from your title and abstract?

github-actions · 2024-11-20T10:59:22Z

⚠️ We have detected a problem with your submission! ⚠️

Please make the aforementioned changes and re-submit :)

github-actions · 2024-11-20T11:13:37Z

👋 Thanks for your submission! We have successfully built your website and we will push it shortly to the URL https://d2jud02ci9yv69.cloudfront.net/2025-04-28-the-usefulness-ceiling-28/blog/the-usefulness-ceiling/ !

* Initial contents (#1) * Update URLs for deployment * Update URL v2 * Update URL v3 * Add image generating code (#2) * Add image generating code * Revert to SVG images * Silence filter-files action * Add initial text (#3) * Add draft text * Organize figures, add captions * Revamp AD part (#4) * Rename "sparse AD" to ASD (#5) * Add initial pattern detection draft (#6) * Remove Mermaid graph * Add color to equations, matching figures (#7) * Attempt to fix LaTeX commands * Add more figures for reverse-mode (#8) * Combine sparsity pattern figures * Rename fw-mode evaluation figure * Add reverse mode figure * Fix caption numbering and references * Add a section about coloring * Add figures showing full ASD forward- and reverse-mode (#10) * New figures: * full ASD forward pass * full ASD forward decompression * full ASD reverse pass * full ASD reverse decompression * Refactor figure code: * Make names of dimensions match blog * Update cell background color mechanism to support row-coloring * Add new figures to blog post * Add equations * Darken figures to help with accessibility (#11) * Revert figures (#12) * Update figures to use Wong colorscheme (#13) * Update figures to use Wong colorscheme * Darker text on overlays * Update colors of equations * Expand coloring section, remove concrete examples * Revert sparsity detection * Add admonition boxes for notes (#20) * Add admonitions * Fix typo in `make_figures.jl` * Include suggestions from PR 14 * Avoid custom commands in inline math (#21) * Add graph visualizations (#24) * Add graph coloring figure * Include figures in blog * Second attempt at including Mermaid diagram (#25) * Mermaid fix v2 * Mermaid fix v3 * Add more graph coloring figures (#26) * Use multivariate function in compute graph (#28) * Update compute graph * Improve figures wrt color blindness * Add a few additional comments in the blog (#29) * Add a few additional comments in the blog * Apply suggestions from code review --------- Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> * Add a first draft for the section about second order (#30) * Add a first draft for the section about second order * Apply suggestions from code review * Apply suggestions from code review * Typo --------- Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> * Update abstract interpretation section, add local vs. global (#31) * Update abstract interpretation section, add local vs. global * Replace compute graph SVG with PNG * Fix TOC * Start demo notebook (#27) * Fix typos * Unify style (#40) * Remove usage of "you" * Fix TOC * Add bicoloring to TOC * Rename and move figures * Include graph coloring figures in text * Remove "(probably)" * Add caption to figure 20 * Replace ternary expression by if-else * Bold input vectors * Reformulate second order pattern detection (#41) * Update and comment demo (#39) * Update and comment demo * Improve comments * TOC * Updates * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Adrian Hill <adrian.hill@mailbox.org> --------- Co-authored-by: Adrian Hill <adrian.hill@mailbox.org> * Clarify HVPs * Add an abstract (#43) * Add refs (#44) * Add references * Typo * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Adrian Hill <adrian.hill@mailbox.org> --------- Co-authored-by: Adrian Hill <adrian.hill@mailbox.org> * Add bicoloring figure (#45) * Minor refactor of cell background colors * Duplicate `DrawMatrix` functionality for bicoloring * Add bicoloring figure * Update 2025-04-28-sparse-autodiff.md (#49) * Upstream updates (#50) * Update deploy-for-review.yml bugfix * Create pull_request_template.md * update filter file workflow: upload-artifact@v2->v4 * Update pull_request_template.md --------- Co-authored-by: busycalibrating <19653980+busycalibrating@users.noreply.github.com> * Final pass and conclusion (#51) * Final pass and conclusion * Remove materialize * Typos * Vertices * TOC * Apply suggestions from code review Co-authored-by: Adrian Hill <adrian.hill@mailbox.org> --------- Co-authored-by: Adrian Hill <adrian.hill@mailbox.org> * Update blog post description (#52) * Minor tweaks before submission (#53) * Add "Jacobian computation" section * Minor fixes to conclusion * Fix captions * Fix inline math * Remove unused abbreviation from abstract * Unified spacing in equations * Smaller figures * Fix figure numbering * Bring back the term "materialization" (#54) * Bring back materialization * Add note on performance * Minor punctuation fix * Note on intermediate Jacobians, performance * Remove "demystify" * Revert CI changes (#55) * Revert CI changes * Remove TODO * Merge ICLR remote * Revert changes on unrelated files * Fix emphasis * Fix ASD backend name in code examples (#56) * Address feedback from reviewers (#58) * Remove low-level comment * Replace "impossible" by "intractable" * Emphasize black-box in figure 6 * Emphasize Jacobian *matrices* * Mention reverse-mode memory * Attempt to fix equation in Fig 16 caption * Add spacing after comma in equation * Explain Conv Jacobian dimensions * Better distinction between matrices and operators * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Alexis Montoison <35051714+amontoison@users.noreply.github.com> * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> --------- Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> Co-authored-by: Alexis Montoison <35051714+amontoison@users.noreply.github.com> * Address further feedback from reviewers (#60) * Minor tweaks * Emphasize JAX and Torch * Further emphasize JAX and friends * More explicit * Minor fix * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> * Add application * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Alexis Montoison <35051714+amontoison@users.noreply.github.com> * Extend quote from HVP blog post * Fixes for full quote * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> * Revamp applications * Minor tweaks --------- Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> Co-authored-by: Alexis Montoison <35051714+amontoison@users.noreply.github.com> * Add authors (#62) * Add mention of Jacobians (#63) * Update affiliations * Fix odd looking citations * Fix typo * Update affiliation style * Add package versions (#64) * Add package versions * Update plots --------- Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> Co-authored-by: Alexis Montoison <alexis.montoison@polymtl.ca> Co-authored-by: Alexis Montoison <35051714+amontoison@users.noreply.github.com> Co-authored-by: busycalibrating <19653980+busycalibrating@users.noreply.github.com>

* Initial contents (iclr-blogposts#1) * Update URLs for deployment * Update URL v2 * Update URL v3 * Add image generating code (iclr-blogposts#2) * Add image generating code * Revert to SVG images * Silence filter-files action * Add initial text (iclr-blogposts#3) * Add draft text * Organize figures, add captions * Revamp AD part (iclr-blogposts#4) * Rename "sparse AD" to ASD (iclr-blogposts#5) * Add initial pattern detection draft (iclr-blogposts#6) * Remove Mermaid graph * Add color to equations, matching figures (iclr-blogposts#7) * Attempt to fix LaTeX commands * Add more figures for reverse-mode (iclr-blogposts#8) * Combine sparsity pattern figures * Rename fw-mode evaluation figure * Add reverse mode figure * Fix caption numbering and references * Add a section about coloring * Add figures showing full ASD forward- and reverse-mode (iclr-blogposts#10) * New figures: * full ASD forward pass * full ASD forward decompression * full ASD reverse pass * full ASD reverse decompression * Refactor figure code: * Make names of dimensions match blog * Update cell background color mechanism to support row-coloring * Add new figures to blog post * Add equations * Darken figures to help with accessibility (iclr-blogposts#11) * Revert figures (iclr-blogposts#12) * Update figures to use Wong colorscheme (iclr-blogposts#13) * Update figures to use Wong colorscheme * Darker text on overlays * Update colors of equations * Expand coloring section, remove concrete examples * Revert sparsity detection * Add admonition boxes for notes (iclr-blogposts#20) * Add admonitions * Fix typo in `make_figures.jl` * Include suggestions from PR 14 * Avoid custom commands in inline math (iclr-blogposts#21) * Add graph visualizations (iclr-blogposts#24) * Add graph coloring figure * Include figures in blog * Second attempt at including Mermaid diagram (iclr-blogposts#25) * Mermaid fix v2 * Mermaid fix v3 * Add more graph coloring figures (iclr-blogposts#26) * Use multivariate function in compute graph (iclr-blogposts#28) * Update compute graph * Improve figures wrt color blindness * Add a few additional comments in the blog (iclr-blogposts#29) * Add a few additional comments in the blog * Apply suggestions from code review --------- Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> * Add a first draft for the section about second order (iclr-blogposts#30) * Add a first draft for the section about second order * Apply suggestions from code review * Apply suggestions from code review * Typo --------- Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> * Update abstract interpretation section, add local vs. global (iclr-blogposts#31) * Update abstract interpretation section, add local vs. global * Replace compute graph SVG with PNG * Fix TOC * Start demo notebook (iclr-blogposts#27) * Fix typos * Unify style (iclr-blogposts#40) * Remove usage of "you" * Fix TOC * Add bicoloring to TOC * Rename and move figures * Include graph coloring figures in text * Remove "(probably)" * Add caption to figure 20 * Replace ternary expression by if-else * Bold input vectors * Reformulate second order pattern detection (iclr-blogposts#41) * Update and comment demo (iclr-blogposts#39) * Update and comment demo * Improve comments * TOC * Updates * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Adrian Hill <adrian.hill@mailbox.org> --------- Co-authored-by: Adrian Hill <adrian.hill@mailbox.org> * Clarify HVPs * Add an abstract (iclr-blogposts#43) * Add refs (iclr-blogposts#44) * Add references * Typo * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Adrian Hill <adrian.hill@mailbox.org> --------- Co-authored-by: Adrian Hill <adrian.hill@mailbox.org> * Add bicoloring figure (iclr-blogposts#45) * Minor refactor of cell background colors * Duplicate `DrawMatrix` functionality for bicoloring * Add bicoloring figure * Update 2025-04-28-sparse-autodiff.md (iclr-blogposts#49) * Upstream updates (iclr-blogposts#50) * Update deploy-for-review.yml bugfix * Create pull_request_template.md * update filter file workflow: upload-artifact@v2->v4 * Update pull_request_template.md --------- Co-authored-by: busycalibrating <19653980+busycalibrating@users.noreply.github.com> * Final pass and conclusion (iclr-blogposts#51) * Final pass and conclusion * Remove materialize * Typos * Vertices * TOC * Apply suggestions from code review Co-authored-by: Adrian Hill <adrian.hill@mailbox.org> --------- Co-authored-by: Adrian Hill <adrian.hill@mailbox.org> * Update blog post description (iclr-blogposts#52) * Minor tweaks before submission (iclr-blogposts#53) * Add "Jacobian computation" section * Minor fixes to conclusion * Fix captions * Fix inline math * Remove unused abbreviation from abstract * Unified spacing in equations * Smaller figures * Fix figure numbering * Bring back the term "materialization" (iclr-blogposts#54) * Bring back materialization * Add note on performance * Minor punctuation fix * Note on intermediate Jacobians, performance * Remove "demystify" * Revert CI changes (iclr-blogposts#55) * Revert CI changes * Remove TODO * Merge ICLR remote * Revert changes on unrelated files * Fix emphasis * Fix ASD backend name in code examples (iclr-blogposts#56) * Address feedback from reviewers (iclr-blogposts#58) * Remove low-level comment * Replace "impossible" by "intractable" * Emphasize black-box in figure 6 * Emphasize Jacobian *matrices* * Mention reverse-mode memory * Attempt to fix equation in Fig 16 caption * Add spacing after comma in equation * Explain Conv Jacobian dimensions * Better distinction between matrices and operators * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Alexis Montoison <35051714+amontoison@users.noreply.github.com> * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> --------- Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> Co-authored-by: Alexis Montoison <35051714+amontoison@users.noreply.github.com> * Address further feedback from reviewers (iclr-blogposts#60) * Minor tweaks * Emphasize JAX and Torch * Further emphasize JAX and friends * More explicit * Minor fix * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> * Add application * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Alexis Montoison <35051714+amontoison@users.noreply.github.com> * Extend quote from HVP blog post * Fixes for full quote * Update _posts/2025-04-28-sparse-autodiff.md Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> * Revamp applications * Minor tweaks --------- Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> Co-authored-by: Alexis Montoison <35051714+amontoison@users.noreply.github.com> * Add authors (iclr-blogposts#62) * Add mention of Jacobians (iclr-blogposts#63) * Update affiliations * Fix odd looking citations * Fix typo * Update affiliation style * Add package versions (iclr-blogposts#64) * Add package versions * Update plots --------- Co-authored-by: Guillaume Dalle <22795598+gdalle@users.noreply.github.com> Co-authored-by: Alexis Montoison <alexis.montoison@polymtl.ca> Co-authored-by: Alexis Montoison <35051714+amontoison@users.noreply.github.com> Co-authored-by: busycalibrating <19653980+busycalibrating@users.noreply.github.com>

blogpost

8098d33

Merge remote-tracking branch 'upstream-iclr/main' into usefulness_cei…

cc69424

…ling

penfever changed the title ~~_posts/2025-04-28-The-Usefulness-Ceiling~~ 2025-04-28-The-Usefulness-Ceiling Nov 16, 2024

trying to fix actions errors

465314e

trying to fix actions errors

46f0ea2

penfever changed the title ~~2025-04-28-The-Usefulness-Ceiling~~ 2025-04-28-the-usefulness-ceiling Nov 16, 2024

Rename 2025-04-28-The-Usefulness-Ceiling.md to 2025-04-28-the-usefuln…

8bfee4f

…ess-ceiling.md

Update 2025-04-28-the-usefulness-ceiling.md

bfd28ee

Update 2025-04-28-the-usefulness-ceiling.md

29e32c0

busycalibrating self-assigned this Apr 23, 2025

busycalibrating added the TODO label Apr 23, 2025

busycalibrating added not submitted; close PR and removed TODO labels May 17, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

2025-04-28-the-usefulness-ceiling#28

2025-04-28-the-usefulness-ceiling#28
penfever wants to merge 7 commits intoiclr-blogposts:mainfrom
penfever:usefulness_ceiling

penfever commented Nov 12, 2024

Uh oh!

busycalibrating commented Nov 16, 2024

Uh oh!

github-actions bot commented Nov 16, 2024

Uh oh!

github-actions bot commented Nov 16, 2024

Uh oh!

github-actions bot commented Nov 16, 2024

Uh oh!

github-actions bot commented Nov 16, 2024

Uh oh!

penfever commented Nov 16, 2024

Uh oh!

busycalibrating commented Nov 16, 2024

Uh oh!

github-actions bot commented Nov 20, 2024

Uh oh!

github-actions bot commented Nov 20, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

penfever commented Nov 12, 2024

Uh oh!

busycalibrating commented Nov 16, 2024

Checklist before opening a PR

Uh oh!

github-actions bot commented Nov 16, 2024

Uh oh!

github-actions bot commented Nov 16, 2024

Uh oh!

github-actions bot commented Nov 16, 2024

Uh oh!

github-actions bot commented Nov 16, 2024

Uh oh!

penfever commented Nov 16, 2024

Uh oh!

busycalibrating commented Nov 16, 2024

Uh oh!

github-actions bot commented Nov 20, 2024

Uh oh!

github-actions bot commented Nov 20, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants