The School is located in Bernardsville, which is in the northernmost part of Somerset County and is 12 miles south of Morristown. The Palmer School is very close to the schools of the Somerset Hills Regional School District:
- Bedwell Elementary School
- Bernardsville Middle School
- Bernards High School
Just down the street from the Palmer School is the Bernardsville Public Library. The library offers many programs and activities suitable for children.