Penalized estimators for estimating regression parameters have been considered by many authors for many decades. Penalized regression with rectangular norm is one of the mainly used since it does variable selection and estimating parameters, simultaneously. In this paper, we propose some new estimators by employing uncertain prior information on parameters. Superiority of the proposed shrinkage estimators over the least absoluate and shrinkage operator (LASSO) estimator is demonstrated via a Monte Carlo study. The prediction rate of the proposed estimators compared to the LASSO estimator is also studied in the US State Facts and Figures dataset.

Usually, we estimate the unknown parameter by observing a random sample and using the usual methods of estimation such as maximum likelihood method. In some situations, we have information about the real parameter in the form of a guess. In these cases, one may shrink the maximum likelihood or other estimators towards a guess value and construct a shrinkage estimator. In this paper, we study the behavior of a Bayes shrinkage estimator for the scale parameter of exponential distribution based on censored samples under an asymmetric and scale invariant loss function. To do this, we propose a Bayes shrinkage estimator and compute the relative efficiency between this estimator and the best linear estimator within a subclass with respect to sample size, hyperparameters of the prior distribution and the vicinity of the guess and real parameter. Also, the obtained results are extended to Weibull and Rayleigh lifetime distributions.

This paper suggests Liu-type shrinkage estimators in linear regression model in the presence of multicollinearity under subspace information. The performance of the proposed estimators is compared to Liu-type estimator in terms of their relative efficiency via a Monte Carlo simulation study and a real data set. The results reveal that the proposed estimators outperform better than the Liu-type estimator.