Skip to content

CODAP-1090: Research CloudFront logs for codap.concord.org URL usage#2339

Closed
dougmartin wants to merge 2 commits intomainfrom
CODAP-1090-research-cloudfront-logs
Closed

CODAP-1090: Research CloudFront logs for codap.concord.org URL usage#2339
dougmartin wants to merge 2 commits intomainfrom
CODAP-1090-research-cloudfront-logs

Conversation

@dougmartin
Copy link
Copy Markdown
Member

Analyze AWS CloudFront access logs to understand how users launch CODAP v2 via different URL paths, informing decisions about release infrastructure.

Key findings (Feb 2025 - Jan 2026):

  • /app is dominant: 3.3M requests (5x more than /releases/latest)
  • /releases/latest: 711K requests, steady usage
  • /releases/stable: 162K requests, collapsed in June 2025
  • Clear school year pattern in /app traffic

Added specs:

  • specs/CODAP-1090-research-cloudfront-logs/requirements.md
  • specs/CODAP-1090-research-cloudfront-logs/implementation.md

Analysis method: AWS Athena queries against S3 logs (~9.5 GB, ~$0.05/query)

Interactive results: https://codap3.concord.org/#shared=https%3A%2F%2Fcfm-shared.concord.org%2FNlLpguqSRh1GOcTkNryt%2Ffile.json

Analyze AWS CloudFront access logs to understand how users launch CODAP v2
via different URL paths, informing decisions about release infrastructure.

Key findings (Feb 2025 - Jan 2026):
- /app is dominant: 3.3M requests (5x more than /releases/latest)
- /releases/latest: 711K requests, steady usage
- /releases/stable: 162K requests, collapsed in June 2025
- Clear school year pattern in /app traffic

Added specs:
- specs/CODAP-1090-research-cloudfront-logs/requirements.md
- specs/CODAP-1090-research-cloudfront-logs/implementation.md

Analysis method: AWS Athena queries against S3 logs (~9.5 GB, ~$0.05/query)

Interactive results: https://codap3.concord.org/#shared=https%3A%2F%2Fcfm-shared.concord.org%2FNlLpguqSRh1GOcTkNryt%2Ffile.json
@dougmartin dougmartin requested a review from kswenson February 4, 2026 14:18
Copy link
Copy Markdown
Member

@kswenson kswenson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 LGTM, other than the point we made at the meeting that it would be good to know more about the /releases (other) group, given that there were almost as many of those as /releases/latest.

…raffic

Break out the "/releases (other)" aggregate category into individual
release paths (e.g., /releases/latest, /releases/stable, /releases/build_0742).
Tighten the launch-point WHERE filter to exclude intermediate directory
paths and non-HTML assets, matching only index.html, the CODAP cert
directory pattern, and bare redirect paths.
@dougmartin
Copy link
Copy Markdown
Member Author

dougmartin commented Feb 10, 2026

I added a commit with updated queries to expand the "other" group and tighten the counts so assets are ignored. Closing as this was just for research.

@dougmartin dougmartin closed this Feb 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants