Ayo had a point still grudge against zemo ( he is unforgivable). Ayo still hates zemo. sorry.
Ayo: Zemo murdered our King T'Chaka at the U.N. The man who chose us. Who chose me to protect him".
Ayo: How could free him?
Falcon: He blew up U.N, he killed King T'Chaka and framed you for it."
Wakanda never forgive that.