When I summon Google Assistant I don't use the voice button on steering wheel I just speak out "OK Google". I listen to XM not FM but when I'm finished w/Google Assistant it returns to XM. I also have my phone sitting in the cup holder while it's plugged into USB port and my phone is a Samsung Note 10+. Try not using the voice button on steering wheel to see if that makes a difference and let us know.