Skip to content

[lex.token] Strike mention of whitespace in phase 7#8409

Merged
tkoeppe merged 1 commit into
cplusplus:mainfrom
AlisdairM:strike_meaningless_whitespace_separating_tokens
Dec 15, 2025
Merged

[lex.token] Strike mention of whitespace in phase 7#8409
tkoeppe merged 1 commit into
cplusplus:mainfrom
AlisdairM:strike_meaningless_whitespace_separating_tokens

Conversation

@AlisdairM

Copy link
Copy Markdown
Contributor

It is meaningless to talk of whitespace separating tokens in phase 7 as whitespace is discarded at the end of phase 4.

It is meaningless to talk of whitespace separating tokens
in phase 7 as whitespace is discarded at the end of phase 4.
@AlisdairM AlisdairM force-pushed the strike_meaningless_whitespace_separating_tokens branch from 7d961e0 to c6fe6de Compare November 12, 2025 23:01
@eisenwave eisenwave added the P3-Other Triaged issue not in P1 or P2 label Nov 13, 2025
@eisenwave

eisenwave commented Nov 13, 2025

Copy link
Copy Markdown
Member

I'm not convinced we should totally remove this wording without even leaving a note. It's a helpful insight that whitespace acts as a separator between the tokens that are processed in this subclause (even if the process of separation happens in a much earlier phase).

Perhaps we could keep just the note that is deleted in this PR and explicitly point out in which phase that separation takes place, with an \iref{lex.phases}.

@AlisdairM

Copy link
Copy Markdown
Contributor Author

I was requested several times in review of other changes to remove this text. It has no normative impact, and truly is nonesense as whitespace does not separate tokens, it simply does not exist for several phases of translation before tokens even exist.

We have already improved the text around phases 3 and 4 where we state that whitespace separates preprocessing tokens, and there are no parts of this text that seem useful to transfer to those other notes.

Comment thread source/lex.tex
@AlisdairM AlisdairM requested a review from jensmaurer December 6, 2025 09:10
@jensmaurer jensmaurer added the after-motions Pull request is to be applied after the pending edits from WG21 straw polls have been applied. label Dec 9, 2025
@tkoeppe tkoeppe merged commit c70792b into cplusplus:main Dec 15, 2025
2 checks passed
@AlisdairM AlisdairM deleted the strike_meaningless_whitespace_separating_tokens branch December 15, 2025 02:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

after-motions Pull request is to be applied after the pending edits from WG21 straw polls have been applied. P3-Other Triaged issue not in P1 or P2

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants