Very disheartening: Ben Affleck and Jennifer Lopez spilt up after less than two years of relationship.

As rumors grow that the marriage of Ben Affleck and Jennifer Lopez is kaput, the actor was spotted Thursday morning leaving a home in the Brentwood neighborhood of Los Angeles, where he’s reportedly been staying and which is about six miles west of the $60 million family mansion in Beverly Hills that he purchased with Lopez last year.

TMZ published photos Thursday that showed Affleck driving away from the Brentwood house, reporting that the “Air” star and director has been spending the night at the residence and has been seen “coming and going.”

TMZ also reported that Affleck was not spotted at the family mansion the night before, apparently citing accounts from paparazzi who have presumably been staking out both homes. The gossip site surmised that Affleck had spent Wednesday night at the Brentwood house and said it could “confirm” that he had been staying at this address “over the past week or so.”

The TMZ report on Affleck’s possible Brentwood hideaway comes amid other stories speculating on problems in his marriage. The Daily Mail on Thursday cited an In Touch story that said the couple “just couldn’t make it work” and are headed for a split after less than two years of marriage. A source told In Touch that Affleck had already moved out of the marital home — which TMZ appeared to have confirmed with its report Thursday.