Though only seen in retrospect, the Day of Pentecost was the beginning of the church. In the context of chapter two, the Holy Ghost was dealing with only Jews. Pentecost was a Jewish feast in a Jewish city with only Jews present.
Please Use The KJV Version
Capitalize All The Names and Places in your answers