The docker documentation is pretty useful with this stuff. I usually don't keep non-running containers, and I do not remember if docker ps lists them. *
Anyhow it's a matter of docker rm | Docker Docs on the non-running container, but read up and check if this makes sense, because I don't know how your environment is set up or what it is you are trying to do.
* docker ls should.