What progress have you made? Part (a) will fall out pretty much as a consequence of the definition of sup (note that a is an upper bound of E (and since R has the least-upper bound property, sup E exists in R).)
For part (b), it's essentially because sup E may turn out to actually equal a...