Dataset Overview
The OnTime flight performance dataset is a comprehensive record of airline traffic data sourced from the United States Bureau of Transportation Statistics (BTS). It tracks the performance of domestic reporting carriers and is widely recognized as a standard benchmark for evaluating the efficiency of analytical (OLAP) database systems. The full dataset covers domestic flight records from 1987 to 2022. For efficiency, we only used the records from 2020 to 2022. Check the dataset source page here.
Total node count: 379
Total edge count: 17,412,876
Dataset Download
You may download this dataset directly from the BTS. You may select years and months by changing the contents in the two curly braces in the command below:
wget --no-check-certificate --continue https://transtats.bts.gov/PREZIP/On_Time_Reporting_Carrier_On_Time_Performance_1987_present_{1987..2022}_{1..12}.zip
Or you can click the button below and download the extracted and selected csv files from our repository:
Benchmark Workloads
Select a platform below to view the specific data loading commands and queries used to benchmark performance.
Runtime Results
* The unit of all results shown below are in seconds (s)
* MEMORY_LIMIT means the query exceeded the 28 GiB memory limit; TIMEOUT means the query ran for more than two hours without finishing; SKIPPED means the database platform does not support certain features required by the query; POOL LIMIT means the intermediate results generated by the query exceeded the engine-configured memory pool limit; FAILED means the system reported another error.
| Workload | Query ID | PuppyGraph | Neo4j | TigerGraph | GraphFrames |
|---|---|---|---|---|---|
| Neighborhood | Q1 | 3.085080 | 1.982000 | 0.369524 | 10.039805 |
| Q2 | POOL LIMIT | 1.767000 | 2.816097 | 10.532004 | |
| Q3 | POOL LIMIT | 1.703000 | 1.908364 | 10.885211 | |
| Q4 | 2.289262 | 2.093000 | 0.324806 | 4.909315 | |
| Path | Q5 | 1.932919 | 1.713000 | 0.010787 | 6.526917 |
| Q6 | 14.578279 | 72.442000 | 2.168803 | 7.411621 | |
| Q7 | POOL LIMIT | 2.118000 | 0.305380 | 16.911237 | |
| Q8 | SKIPPED | 1.901000 | 3.388603 | 20.719130 | |
| Q9 | TIMEOUT | 1.854000 | 11.438786 | 7.265614 | |
| Q10 | TIMEOUT | 1.826000 | 10.074286 | TIMEOUT | |
| Pattern | Q11 | POOL LIMIT | TIMEOUT | 12.050454 | TIMEOUT |
| Q12 | POOL LIMIT | POOL LIMIT | 698.602931 | TIMEOUT | |
| Q13 | 2.446091 | 9.876000 | 1.801996 | 7.008107 | |
| Q14 | POOL LIMIT | POOL LIMIT | 4.240648 | TIMEOUT | |
| Q15 | 126.846673 | 902.815000 | 2.490173 | 200.714954 | |
| Q16 | SKIPPED | TIMEOUT | TIMEOUT | FAILED | |
| Aggregation | Q17 | 3.110169 | 21.687000 | 2.256630 | 7.387379 |
| Q18 | 4.015550 | 8.267000 | 2.140957 | 7.269696 | |
| Q19 | 2.398963 | 10.810000 | 0.858335 | 4.441112 | |
| Q20 | 2.049456 | 11.444000 | 2.610575 | 4.738949 | |
| Q21 | POOL LIMIT | TIMEOUT | 2.543292 | TIMEOUT | |
| Q22 | POOL LIMIT | TIMEOUT | 2.618368 | TIMEOUT | |
| Q23 | 2.765382 | 558.126000 | 2.267799 | 6.589446 | |
| Analytics | Q24 | 3.098759 | 307.745000 | 2.811372 | 7.322749 |
| Q25 | 56.945074 | 4.606000 | 31.442381 | 40.821521 | |
| Q26 | 10.977261 | 1.646000 | 4.514143 | 22.234368 | |
| Hybrid | Q27 | 2.643898 | FAILED | TIMEOUT | 6.731787 |
| Q28 | 1.920196 | FAILED | TIMEOUT | 6.016542 | |
| Q29 | 1.800114 | 20.641000 | 2.999915 | 8.594041 | |
| Q30 | 1.950251 | 79.313000 | 3.756786 | 6.845215 |
Memory Results
* The unit of all memory results shown below is megabytes (MB)
* TigerGraph: the sum over the GPEs of each GPE’s peak vertex-accumulator memory for the whole query, from the query profile; not process memory.
* MEMORY_LIMIT means the query exceeded the 28 GiB memory limit; TIMEOUT means the query ran for more than two hours without finishing; SKIPPED means the database platform does not support certain features required by the query; POOL LIMIT means the intermediate results generated by the query exceeded the engine-configured memory pool limit; FAILED means the system reported another error.
| Workload | Query ID | PuppyGraph | Neo4j | TigerGraph | GraphFrames |
|---|---|---|---|---|---|
| Neighborhood | Q1 | 192.659000 | 0.101592 | 0.000000 | 75.497456 |
| Q2 | POOL LIMIT | 0.001112 | 0.000000 | 75.497456 | |
| Q3 | POOL LIMIT | 0.001112 | 0.000000 | 75.497456 | |
| Q4 | 165.683000 | 0.058400 | 0.000000 | 75.497456 | |
| Path | Q5 | 184.934000 | 0.001952 | 0.000000 | 75.497456 |
| Q6 | 214.683000 | 27.398756 | 0.000000 | 75.497456 | |
| Q7 | POOL LIMIT | 0.000496 | 0.000000 | 75.497456 | |
| Q8 | SKIPPED | 0.002624 | 0.000000 | 75.497456 | |
| Q9 | TIMEOUT | 0.000624 | 0.000000 | 75.497456 | |
| Q10 | TIMEOUT | 0.000624 | 0.000000 | TIMEOUT | |
| Pattern | Q11 | POOL LIMIT | TIMEOUT | 0.000000 | TIMEOUT |
| Q12 | POOL LIMIT | POOL LIMIT | 6.000000 | TIMEOUT | |
| Q13 | 162.676000 | 0.051152 | 0.000000 | 135.800392 | |
| Q14 | POOL LIMIT | POOL LIMIT | 0.000000 | TIMEOUT | |
| Q15 | 161.560000 | 4.940864 | 0.000000 | 75.497456 | |
| Q16 | SKIPPED | TIMEOUT | TIMEOUT | FAILED | |
| Aggregation | Q17 | 228.676000 | 418.485704 | 0.000000 | 135.691144 |
| Q18 | 331.535000 | 418.486752 | 0.000000 | 135.691144 | |
| Q19 | 165.333000 | 0.041288 | 0.000000 | 0.262144 | |
| Q20 | 183.958000 | 0.852496 | 0.000000 | 75.497456 | |
| Q21 | POOL LIMIT | TIMEOUT | 0.000000 | TIMEOUT | |
| Q22 | POOL LIMIT | TIMEOUT | 0.000000 | TIMEOUT | |
| Q23 | 295.383000 | 30.804336 | 0.000000 | 75.497456 | |
| Analytics | Q24 | 369.925000 | 0.743476 | 0.000000 | 135.454480 |
| Q25 | 1.924000 | 0.022120 | 26.000000 | 75.497456 | |
| Q26 | 2.915000 | 0.001336 | 0.000000 | 75.497456 | |
| Hybrid | Q27 | 306.050000 | FAILED | TIMEOUT | 68.445048 |
| Q28 | 203.708000 | FAILED | TIMEOUT | 68.445048 | |
| Q29 | 55.474000 | 2.115232 | 0.000000 | 134.767464 | |
| Q30 | 56.451000 | 3.959520 | 0.000000 | 134.767464 |