As the summary suggests, Loi is a goat demon who is saved by a God named Xiu. Loi, also referred to as Leutschekta, protects humans from harmful demons and cures their diseases. Of course, when humans see his monstrous form, they come to the "if it looks evil, it is evil and causing these bad things to happen" conclusion. After Xiu saves him, he grants him a more human friendly goat form. I love both of Loi's demon forms, though I am more fond of the form Xiu gave him because he looks adorable.
This manga includes great sex scenes, malicious demon possession, and a cute kid who befriends Loi. I did wish Masato, the boy, got to see Loi's human form, but I suppose that could happen later on in the manga.
I've only read the 3 chapters that were scanlated by Naono Holics (at the moment, you can get the download links on their livejournal). Of course, the other 3 (?) chapters might just be one-shots that have also been scanlated, but since I don't know the full lists of works in this manga, I can't say anything for sure.
Regardless, the series is to be read in this order:
Mayonaka no Acchimono
Acchimono no Toubou read more