The discovery of gold in most parts of Ghana has resulted in the emergence of illegal small-scale gold mining activities alongside water bodies. This paper investigated illegal small-scale gold mining vis-à-vis the Black Volta River water quality in Ghana. Water samples were collected from three sites along the Block Volta River and some physicochemical parameters of the sampled water were analyzed. In addition, informal interviews were conducted using purposive and simple random sampling methods to understand the perspectives of the illegal small-scale miners on laws governing mining and the environment in Ghana. The results showed that some physicochemical parameters are high at the upstream of the Black Volta River. However, the illegal small-scale miners had poor knowledge of mining laws and the impact of their activities on the Black Volta River water quality. The study proposes the strict enforcement of environmental laws in Ghana to stop illegal small-scale mining activities on and near water bodies.