You CAN argue with cheap if it doesn't deliver results. $1 4-packs are most likely not alkaline batteries, so they won't last long. You'll end up replacing them way too often.
Get some solid Ni-MH rechargeable batteries and save yourself some money. Costco in Canada sells a charger and 4 batteries for $20.