A smart motorway system "wasn't working as it should be" at the time of a fatal collision on the M4, a court has heard.