Organisers are pushing ahead with plans to build a Brexit museum this autumn despite coronavirus sparking delays.