Skip to content

Flag bootstrapping argument to be changed to allow parameter uncertainty #329

Closed

Description

@andrewbaxter439

As a brief follow up and documenting of ideas at meeting 2026-01-27, we noted that:

  • Paramters.bootstrapAll is false by default
  • This needs enabled for multiruns to bootstrap for parameter uncertainty
  • The user may not know that this is the case (missing from documentation)

Possible small changes to better handle this:

  • Add in bootstrapping to wiki
  • Parameter bootstrapAll could be de-finalised and made modifiable in config file and CLI args (via multirun class)
  • For multiruns the parameter could be set to true (and left as-is for GUI runs)
  • OR, could set a warning flag in console in multiruns to alert the user that no bootstrapping is ideal for development environment but this should be enabled for valid statistical outputs

A few possible changes which can easily be made. Can discuss ongoing!

Activity

  1. igelstorm commented on Oct 27, 2026

    @igelstorm
    Contributor

    @matteorichiardi @dav-sonn This is the issue that was just discussed in today's meeting regarding bootstrapping - it is still listed as in progress on the SimPaths development board, so I didn't think opening a new issue seemed appropriate.

    The current state of the code is that bootstrapAll is always true, in other words bootstrapping is always on, even for single runs. I don't know if this was intended or not, but from today's discussion I gather it's likely not.

    I recall that we previously discussed a few possible solutions in a development meeting, including:

    • Making bootstrapping configurable, either through a CLI argument or the config YAML file
    • Making bootstrapping-on the default for multiruns only, but keeping bootstrapping-off as the default for single runs

    The latter might be the most straightforward - e.g. by adding a static method Parameters.setBootstrapAll analogous to the existing Parameters.setTrainingFlag, which can be called in SimPathsStart and SimPathsMultiRun to set different values (the final keyword would need to be removed from the bootstrapAll declaration).

  2. andrewbaxter439 commented on Oct 27, 2026

    @andrewbaxter439
    CollaboratorAuthor

    A suggested approach implemented in #549

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions