Meanwhile, in a separate skillet, heat 1 tablespoon of olive oil and heat on medium-high. Brown the sliced Kielbasa sausage for about 5 minutes. Add the peppers to the skillet and season with salt and pepper. Cook until peppers are softened but still crunchy, about 3 to 5 minutes, stirring occasionally.