Add checksum verification metrics and logging to improve read statistics - #72
Draft
SaadASTheDev wants to merge 28 commits into
Draft
Add checksum verification metrics and logging to improve read statistics#72SaadASTheDev wants to merge 28 commits into
SaadASTheDev wants to merge 28 commits into
Conversation
…ble with node.js 12 to avoid compilation error. (will be in 3.4.0) Reviewed-by: Shilun Fan <slfan1989@apache.org> Signed-off-by: Ayush Saxena <ayushsaxena@apache.org> (cherry picked from commit a822a3c)
…ow mutation of its internal state (not yet merged upstream) * SaslPropertiesResolver should not allow mutation of its internal state * Keep SASL properties map sorted --------- Co-authored-by: Charles Connell <cconnell@hubspot.com> (cherry picked from commit 6761522)
…when datanodes close idle connections
…ing dn with many ec blocks (apache#4398)
…y max-streams-hard-limit configuration (apache#5143) Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
…freshable (apache#4567) Reviewed-by: Hiroyuki Adachi <hadachi@yahoo-corp.jp> Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
…plicatedTasks and numReplicationTasks during block recovery (apache#6348) Reviewed-by: Shilun Fan <slfan1989@apache.org> Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
…native codec. (apache#5520). Contributed by WangYuanben. Reviewed-by: Tao Li <tomscut@apache.org> Reviewed-by: Shilun Fan <slfan1989@apache.org> Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
…yteBufferPool in DFSStripedInputStream (not yet upstreamed)
…ddTransferRateMetric() (will be in 3.4.0) Reviewed-by: Ravindra Dingankar <rdingankar@linkedin.com> Reviewed-by: Simbarashe Dzinamarira <sdzinamarira@linkedin.com> Reviewed-by: Tao Li <tomscut@apache.org> Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
… S3 use cases (not yet written upstream) - Leave config in same place - Disable deployAtEnd - Increase build timeout for Hadoop
…etwork-distance FileSystem metrics (not yet merged upstream)
…its in a single thread (will be in 3.4.0) Contributed by Moditha Hewasinghage Co-authored-by: Moditha Hewasinghage <33624668+modithah@users.noreply.github.com>
…15865 (will be in 3.4.0) Co-authored-by: Hiroaki Segawa <goto@stonedot.com>
This will help us use a performant job submitter in SKIR
* log the timestamp difference instead of throwing exception. * keep trailing slash for s3 filesystems use. * revert to original * add check if the cluster is a S3 cluster * null check * more universal check
…ill be in 3.4.2) Contributed by Sebastian Klemke Co-authored-by: Sebastian Klemke <3669903+packet23@users.noreply.github.com>
…lease renewal interval (not yet merged upstream)
…ill be in 3.4.3) Backport of apache#7886 to hubspot-3.3.6. Replaces all uses of deprecated-for-removal Subject.getSubject()/Subject.doAs() APIs with the new SubjectUtil compatibility layer that uses MethodHandle to dispatch to Subject.current()/Subject.callAs() on Java 18+ and falls back to the legacy APIs on older JVMs. This unblocks running on Java 25 where the old APIs throw UnsupportedOperationException. Changes: - Add SubjectUtil utility class (from upstream) with Java version adaptive dispatch via MethodHandle - Add TestSubjectUtil (ported from JUnit 5 to JUnit 4 for 3.3.6) - KerberosAuthenticator: Subject.getSubject() -> SubjectUtil.current() - UserGroupInformation.getCurrentUser(): Subject.getSubject() -> SubjectUtil.current() - UserGroupInformation.doAs(PrivilegedAction): Subject.doAs() -> SubjectUtil.doAs() - UserGroupInformation.doAs(PrivilegedExceptionAction): Subject.doAs() -> SubjectUtil.doAs() Co-authored-by: rmdmattingly <rmattingly@hubspot.com> Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
… sorted properly in LocatedBlocks. (will be in 3.4.0) Co-authored-by: WangYuanben <48795318+YuanbenWang@users.noreply.github.com>
charlesconnell
force-pushed
the
hubspot-3.3.6
branch
from
July 29, 2026 16:28
0057a70 to
c1f38bb
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
16 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
NOTICE
Please create an issue in ASF JIRA before opening a pull request,
and you need to set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. HADOOP-XXXXX. Fix a typo in YYY.)
For more details, please see https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute