An optimal solution for automatic fish detection and species classification does not exist mainly because of the challenges present in underwater videos due to environmental variations. To overcome these challenges, we propose a hybrid solution with our model which also gives an estimate on the population count for the species and stores this data in a cloud and is mapped accordingly.