@Terpla you can add modules to keep activated using the ModuleActivePermanentSetTitlePattern property in the configuration. It takes a JSON array of strings. Each string is used as a regular epression pattern to test the modules title with. If any of the pattern matches, the module is activated.
Try this as configuration:
{ "ModuleActivePermanentSetTitlePattern": ["Tracking"]}