Tap and hold on a comment and you'll have the option to edit or delete it.
*Grandparents and other relatives can only delete their own comments. However, album members not allowed to comment also won't be able to edit or delete their comments. In this case, please contact one of the Album Admins (parent members).