If the volume is being referenced by a container, it will not let you delete it.
You might end up with the following error:
Error response from daemon: unable to remove volume: remove DataVolume: volume is in use - [d0d2233b668eddad4986313c7a4a1bc0d2edaf0c7e1c02a6a6256de27db17a63]