This video describes some of the common problems in distributed systems.

You might get an idea about how complicated building such systems is, and also a few ways of thinking about them, and maybe some approaches that need to be considered when deciding to go distributed.

If you don’t know about the CAP theorem i strongly encourage you to read about it first.

Also the page about “Fallacies of Distributed Computing” contains some introduction to the type of problems distributed systems have to deal with.