Tony Pulis says Albion did not deserve to lose to out-of-form Swansea after the Baggies were denied two spot-kicks in a disappointing 1-0 defeat.
Albion fell behind in the ninth minute when Ki Sung-yeung capitalised on Boaz Myhill's fumble.
But Pulis was again left questioning the officials after Chris Brunt was tripped in the area and Callum McManaman brought down when through on goal.
Referee Roger East waved away both appeals and Pulis believes Albion are not getting the rub of the green at the moment.
"The lads are disappointed, their spirit was fantastic, but we have to hope we get a little bit of luck," said the Welshman.
"There were two penalty decisions and you need referees to make the right call. Chris Brunt had a nailed-on penalty and you look at Callum McManaman's at the end and it was a penalty again.
"Roger East is close enough and as a Premier League referee you have to pick it.
"Hopefully on Monday we will play as hard as we did today and get the breaks."