In a large bowl, whisk milk, pudding mix and vanilla for 2 minutes (mixture will be thick). Fold in 3 cups whipped topping.
Pour 1-1/3 cups pudding mixture into pie crust. Layer with banana slices and remaining pudding mixture. Top with remaining whipped topping. If desired, garnish with additional banana slices. Refrigerate until serving.