It seems fiducial markers with id 0 are actively ignored in the mapping process. No blue line is drawn between existing markers and marker id 0, and /fiducial_map does not publish fiducial_id: 0
Replacing marker 0 with any other marker fixes the issue.