The West Brom goalkeeper was pleased his team's performance at Wembley.
Although they are yet to appoint a permanent successor to Tony Pulis, with Gary Megson placed in temporary charge, West Brom produced a spirited performance at Wembley and took the lead through Salomon Rondon, only for Harry Kane to level for Tottenham.
Foster, however, was left delighted with West Brom's performance as they brought an end to a wretched sequence of results that had seen them lose four Premier League games in succession.
Foster told the club's official website: "It was a shame (we couldn't hold on) but we're absolutely delighted, it's a really good point.
"It's a tough place to come and get anything. There'll be a lot of teams who come here and get absolutely pumped.
"It's a good place to start and we can build from this."
West Brom showed excellent spirit against Tottenham and played with a sense of cohesion that was sorely lacking in many of their previous games this campaign.
Up next for West Brom is a home game against Newcastle United tomorrow night and the Baggies will be determined to prevail past opponents who have struggled of late.
Alan Pardew is close to being appointed as West Brom manager, as reported by Sky Sports, and should he get the job the 56-year-old will hope to make the side more of an attacking threat.
West Brom have mustered just ten goals in the Premier League so far this season and will certainly have to improve significantly in that regard if they are to stay in the division.