Loved ones talk about 'hardest times' of Bishop Eddie Long's life