Residual plausibility checks
Implausible records the 2021 rules let through, counted on the final analysis dataset by vendor (reported, not removed).
8 rows Download CSV
| keyTEXT | labelTEXT | conditionTEXT | reasonTEXT | rowsINTEGER | shareREAL | vendor1_rowsINTEGER | vendor2_rowsINTEGER | vendor1_tripsINTEGER | vendor2_tripsINTEGER |
|---|---|---|---|---|---|---|---|---|---|
| speed_over_60mph | Average speed above 60 mph | trip_distance / (travel_time / 60.0) > 60 | New York City's top speed limit is 50 mph; an average above 60 over a whole trip points to a distance or clock error. | 33474 | 0.000446850924436366 | 24526 | 8948 | 26068642 | 48842247 |
| under_one_minute | Shorter than one minute | travel_time < 1 | Rides under a minute are usually cancelled at the kerb or a meter started by mistake. | 191992 | 0.00256293848014539 | 54195 | 137797 | 26068642 | 48842247 |
| tiny_distance_long_time | Under 0.1 mile but over 30 minutes | trip_distance < 0.1 AND travel_time > 30 | A meter that recorded time but almost no distance: a stuck odometer or a waiting fare. | 475 | 0.000006340867213576921 | 0 | 475 | 26068642 | 48842247 |
| over_50_miles | Longer than 50 miles | trip_distance > 50 | Possible for out-of-town fares, but rare enough to check. | 184 | 0.0000024562517206276915 | 47 | 137 | 26068642 | 48842247 |
| total_excludes_congestion | Total leaves out the congestion surcharge | congestion_surcharge > 0 AND abs(total_amount - (fare_amount + extra + mta_tax + tip_amount + tolls_amount + improvement_surcharge)) <= 0.01 | The total equals every other charge but not the $2.50 congestion surcharge recorded on the same row. A vendor reporting convention rather than a pricing error, but any analysis of total fares by vendor would be off by $2.50. | 23397653 | 0.31233981217336776 | 23397647 | 6 | 26068642 | 48842247 |
| total_other_mismatch | Total differs from the sum of its parts (other) | abs(total_amount - (fare_amount + extra + mta_tax + tip_amount + tolls_amount + improvement_surcharge + congestion_surcharge)) > 0.01 AND NOT (congestion_surcharge > 0 AND abs(total_amount - (fare_amount + extra + mta_tax + tip_amount + tolls_amount + improvement_surcharge)) <= 0.01) | The total should equal fare + extra + MTA tax + tip + tolls + improvement + congestion surcharges. | 164443 | 0.0021951815309520623 | 0 | 164443 | 26068642 | 48842247 |
| jfk_flat_fare_not_52 | Rate code 2 (JFK) fare not $52 | RatecodeID = 2 AND fare_amount <> 52 | The Manhattan-JFK flat fare was $52 throughout 2019. | 352 | 0.000004698916335113844 | 45 | 307 | 26068642 | 48842247 |
| high_fare_per_mile | Standard rate above $25 per mile (1 mile or more) | RatecodeID = 1 AND trip_distance >= 1 AND fare_amount / trip_distance > 25 | At $2.50 a mile plus waiting time, a standard-rate fare far above $25 a mile is unlikely. | 477 | 0.000006367565601844613 | 186 | 291 | 26068642 | 48842247 |