Statistics 12 fix unknown estimates#614

Open

sopel39 wants to merge 105 commits intomasterfrom

statistics-12-fix_unknown_estimates

Commits on Jun 29, 2017

Assign type to symbol in TestRemoveUnreferencedScalarLateralNodes
losipiuk
committed
Build instruction with maven wrapper

Lewuathe
authored and
losipiuk
committed
Add doc for statistics
losipiuk
committed
Remove display-only stats tests

kokosing
authored and
losipiuk
committed
Rename cost concept to stats
losipiuk
committed
Test for cost/stats calculation done by CoefficientBasedStatsCalculator

kokosing
authored and
losipiuk
committed
Allow passing external QueryRunner to RuleTester
losipiuk
committed
Add rule to push down table constraints

rschlussel-zz
authored and
losipiuk
committed
Add ATQ test for table constraints infinite loop bug

rschlussel-zz
authored and
losipiuk
committed
Remove Filter above TableScan logic from CoefficientBasedStatsCalculator
losipiuk
committed
Change StatsCalculator API to use Lookup for computing child costs

rschlussel-zz
authored and
losipiuk
committed
Use doubles instead Estimates in PlanNodeStatsEstimate
losipiuk
committed
Add precondition checks in PlanNodeStatsEstimate constructor
losipiuk
committed
Estimate default outputSizeInBytes based on outputRows

pnowojski
authored and
losipiuk
committed
Introduce CostCalculator interface

pnowojski
authored and
losipiuk
committed
Print cost estimate in Explain

pnowojski
authored and
losipiuk
committed
Refactor getQueryMaxMemory session property getter

pnowojski
authored and
losipiuk
committed
Introduce CostComparator

pnowojski
authored and
losipiuk
committed
Replace nulls count with nulls fraction in column statistics
losipiuk
committed
Introduce range column statistics
losipiuk
committed
Return low/high value in show stats
losipiuk
committed
Expose min/max value in statistics for Hive tables
losipiuk
committed
Change argument type in TpchMetadata.getPrestoType to TpchColumn

ArturGajowy
authored and
losipiuk
committed
Add Constraint.alwaysFalse() method

ArturGajowy
authored and
losipiuk
committed
Add TestTpchMetadata

ArturGajowy
authored and
losipiuk
committed
Add Optionals.{checkPresent,withBoth,combine} util methods

ArturGajowy
authored and
losipiuk
committed
Add Types.{checkType,checkSameTypes,tryCast} util methods

ArturGajowy
authored and
losipiuk
committed
Add RecordTpchTableStatsTool for recording stats summaries in .json

ArturGajowy
authored and
losipiuk
committed
Add statistics recordings for tpch.{tiny,sf1}

ArturGajowy
authored and
losipiuk
committed
Add EstimateAssertion

ArturGajowy
authored and
losipiuk
committed
Support column stats in TPCH connector

ArturGajowy
authored and
losipiuk
committed
Introduce DomainConverted

fiedukow
authored and
losipiuk
committed

Commits on Jul 3, 2017

Add clearRanges to ColumnStatistics.builder()

losipiuk
authored and
fiedukow
committed
Add Symbol statistics to PlanNodeStatsEstimate

losipiuk
authored and
fiedukow
committed
Add mapping functions to SymbolStatsEstimate

kokosing
authored and
fiedukow
committed
Remove explicit data_size from PlanNodeStatsEstimate

losipiuk
authored and
fiedukow
committed
Add OutputNode support to PlanBuilder

losipiuk
authored and
fiedukow
committed
Add ColumnStatistics.UNKNOWN_COLUMN_STATISTICS

losipiuk
authored and
fiedukow
committed
Support column stats in StatisticsAssertion

losipiuk
authored and
fiedukow
committed
Add PlanNodeStatisticsAssertion

losipiuk
authored and
fiedukow
committed
Add support for LocalQueryRunner in StatisticsAssertion

losipiuk
authored and
fiedukow
committed
Add ComposableStatsCalculator

losipiuk
authored and
fiedukow
committed
Allow using ComposableStatsCalculator instead of CoefficientBasedStatsCalculator

losipiuk
authored and
fiedukow
committed
Add stats calculator unit testing framework

losipiuk
authored and
fiedukow
committed
Add TestTpchLocalStats stub

losipiuk
authored and
fiedukow
committed
Add FilterStatsCalculator
fiedukow
committed
Add stats calculation for FilterNode comparisons
fiedukow
committed
Add stats calculation for FilterNode boolean expressions
fiedukow
committed
Add stats calculation for FilterNode logical operations
fiedukow
committed
Add stats calculation for FilterNode is (not) null expression
fiedukow
committed
Add stats calculation for FilterNode comparison related operators
fiedukow
committed
Add ScalarStatsCalculator

losipiuk
authored and
fiedukow
committed
Add OutputStatsRule

losipiuk
authored and
fiedukow
committed
Add support for low/high values in StatisticsAssertion

losipiuk
authored and
fiedukow
committed
Add TableScanStatsRule

losipiuk
authored and
fiedukow
committed
Do not check symobol statistics in PlanStatsMatcher

losipiuk
authored and
fiedukow
committed
TestStatsCalculator tests new version of calculator

losipiuk
authored and
fiedukow
committed
Add rule for computing stats for ValuesNode

losipiuk
authored and
fiedukow
committed
Add LimitStatsRule (TODO)

losipiuk
authored and
fiedukow
committed
Add EnforceSingleRowStatsRule (TODO)

losipiuk
authored and
fiedukow
committed
Implement ExchangeStatsRule for single source

losipiuk
authored and
fiedukow
committed
Add ProjectStatsRule (TODO)

losipiuk
authored and
fiedukow
committed
Add rule for computing stats for FilterNode
fiedukow
committed
Add verifyExactColumnStatistics utility method to StatisticsAssertion

sopel39
authored and
fiedukow
committed
Add scalar stats estimation for SymbolReference

losipiuk
authored and
fiedukow
committed
Add scalar stats estimation for Literal

losipiuk
authored and
fiedukow
committed
Use new stats calculator by default
fiedukow
committed
Use nearlyEquals for estimate comparison

kokosing
authored and
fiedukow
committed
Add scalar stats estimation for Cast

losipiuk
authored and
fiedukow
committed
Add scalar stats estimation for ArithmeticBinaryExpression

kokosing
authored and
fiedukow
committed
Add scalar stats estimation for CoalesceExpression

kokosing
authored and
fiedukow
committed
Add SymbolStatsAssertion.isEqualTo

losipiuk
authored and
fiedukow
committed
Add test for symbol reference stats calculation

losipiuk
authored and
fiedukow
committed
Add JoinStatsRule to support equi-conditions and filters

sopel39
authored and
fiedukow
committed
Make StatsCalculaterTester to be closeable

kokosing
authored and
fiedukow
committed
Add statistic estimation for simple AggregationNode

kokosing
authored and
fiedukow
committed
Introduce stats Normalizer

kokosing
authored and
fiedukow
committed
Cap distinct values count to ouptut rows count

kokosing
authored and
fiedukow
committed
Cap distinct values count to type domain range length

kokosing
authored and
fiedukow
committed
Ensure all output symbols have stats estimates

kokosing
authored and
fiedukow
committed
Move pattern matching to separate package

kokosing
authored and
fiedukow
committed
Use TreeTraverser in MatchingEngine

kokosing
authored and
fiedukow
committed
Check interfaces of given object when checking pattern

kokosing
authored and
fiedukow
committed
Use Set collection to store stats estimation rules

kokosing
authored and
fiedukow
committed
Use pattern matching in ComposableStatsCalculator

kokosing
authored and
fiedukow
committed
Add UnionStatsRule

kokosing
authored and
fiedukow
committed
Support multi source exchange

kokosing
authored and
fiedukow
committed

Commits on Jul 7, 2017

Commits on Jul 12, 2017

fixup! Introduce CostCalculator interface
sopel39
committed