Benchmarks

This page lists benchmark results obtained by recent versions of the PyVRP package. See the benchmarking instructions for how these benchmarks are run.

v0.2.0 (13 May 2023)

This benchmark concerns commit 3784f03. The configuration files used are configs/cvrp.toml and configs/vrptw.toml. The gaps below are computed against best-known solutions obtained from CVRPLIB on 28 February 2023.

CVRP

Average gaps over ten seeds on the X-instances:

                 PyVRP  HGS-CVRP

       Mean gap  0.25%     0.11%
Gap of the mean  0.35%     0.16%

VRPTW

Average gaps over ten seeds on the Gehring and Homberger instances with 1000 customers:

                 PyVRP  HGS-DIMACS

       Mean gap  0.43%       0.32%
Gap of the mean  0.52%       0.37%

v0.1.0 (1 March 2023)

This benchmark concerns commit e1b1ac7, the version used to obtain the results of the initial submission. The gaps below are computed against best-known solutions obtained from CVRPLIB on 28 February 2023. The parameter values were changed somewhat from the defaults in that commit. The relevant configuration files can be found in 3c26fab, under configs/.

CVRP

Average gaps over ten seeds on the X-instances:

                 PyVRP  HGS-CVRP

       Mean gap  0.22%     0.11%
Gap of the mean  0.30%     0.16%

VRPTW

Average gaps over ten seeds on the Gehring and Homberger instances with 1000 customers:

                 PyVRP  HGS-DIMACS

       Mean gap  0.45%       0.32%
Gap of the mean  0.54%       0.37%