This paper examines the challenges of implementation of international humanitarian law in Africa. The author noted that the reason for the inherent challenges towards implementation of IHL is to the effect that there is not in existence a central body of law enforcement. Thus, the author opines that for effective implementation, the parties concerned in the conflict must know and understand the content of humanitarian law. Furthermore, the author traces the historical background of humanitarian law in Africa and also the existing framework of international humanitarian law. The paper further critically examines the challenges of implementation of humanitarian law under two categories which are prominent in IHL such as International Armed Conflict and Non-International Armed Conflict. The author concluded that one of the major violators of IHL are the non-state actors who have little or no knowledge about IHL. The author further encourages that the non state actors should be made to ratify and implement the IHL Laws and further recommendations were given as a panacea to the existing challenges.