It shouldn't be hard but people who are heavily followed might experience latency problems, which may be the current issue since steemit seems to get ddos'd regularly, causing site outages.
It would most likely come as a future implementation though
RE: [Ask Steemit] When will we get a follower/followed list?