Penalized estimators for estimating regression parameters have been considered by many authors for many decades. Penalized regression with rectangular norm is one of the mainly used since it does variable selection and estimating parameters, simultaneously. In this paper, we propose some new estimators by employing uncertain prior information on parameters. Superiority of the proposed shrinkage estimators over the least absoluate and shrinkage operator (LASSO) estimator is demonstrated via a Monte Carlo study. The prediction rate of the proposed estimators compared to the LASSO estimator is also studied in the US State Facts and Figures dataset.