Former chief executive of EAT Andrew Walker has joined the board of all-day London eatery Farmer J as a non-executive director.