The U.S. Marshals arrested Keith Holmes around 10 a.m. Wednesday at a family member's apartment on the unit block of N. 63rd Street.
The Marshals said Holmes surrendered after they knocked on the family member's door and announced their presence.
Holmes had a warrant for aggravated assault and other offenses.
The shooting happened around 6:40 p.m. on Thursday, April 10, at 57th Street and Kingsessing Avenue.
Neighbors told Action News it all started because several kids were stomping on a newly paved patch of concrete in front of the suspect's house.
They say Holmes and his teenage son confronted the group, and a fight started. At some point, police say Holmes fired a gun, hitting the 13-year-old victim twice in the stomach.
The teen was taken to the hospital in critical condition but is expected to survive.