2010
Perez-Cruz, Fernando; Kulkarni, S R
Robust and Low Complexity Distributed Kernel Least Squares Learning in Sensor Networks Artículo de revista
En: IEEE Signal Processing Letters, vol. 17, no 4, pp. 355–358, 2010, ISSN: 1070-9908.
Resumen | Enlaces | BibTeX | Etiquetas: communication complexity, Consensus, distributed learning, kernel methods, learning (artificial intelligence), low complexity distributed kernel least squares le, message passing, message-passing algorithms, robust nonparametric statistics, sensor network learning, sensor networks, telecommunication computing, Wireless Sensor Networks
@article{Perez-Cruz2010,
title = {Robust and Low Complexity Distributed Kernel Least Squares Learning in Sensor Networks},
author = {Fernando Perez-Cruz and S R Kulkarni},
url = {http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=5395679},
issn = {1070-9908},
year = {2010},
date = {2010-01-01},
journal = {IEEE Signal Processing Letters},
volume = {17},
number = {4},
pages = {355--358},
abstract = {We present a novel mechanism for consensus building in sensor networks. The proposed algorithm has three main properties that make it suitable for sensor network learning. First, the proposed algorithm is based on robust nonparametric statistics and thereby needs little prior knowledge about the network and the function that needs to be estimated. Second, the algorithm uses only local information about the network and it communicates only with nearby sensors. Third, the algorithm is completely asynchronous and robust. It does not need to coordinate the sensors to estimate the underlying function and it is not affected if other sensors in the network stop working. Therefore, the proposed algorithm is an ideal candidate for sensor networks deployed in remote and inaccessible areas, which might need to change their objective once they have been set up.},
keywords = {communication complexity, Consensus, distributed learning, kernel methods, learning (artificial intelligence), low complexity distributed kernel least squares le, message passing, message-passing algorithms, robust nonparametric statistics, sensor network learning, sensor networks, telecommunication computing, Wireless Sensor Networks},
pubstate = {published},
tppubtype = {article}
}
We present a novel mechanism for consensus building in sensor networks. The proposed algorithm has three main properties that make it suitable for sensor network learning. First, the proposed algorithm is based on robust nonparametric statistics and thereby needs little prior knowledge about the network and the function that needs to be estimated. Second, the algorithm uses only local information about the network and it communicates only with nearby sensors. Third, the algorithm is completely asynchronous and robust. It does not need to coordinate the sensors to estimate the underlying function and it is not affected if other sensors in the network stop working. Therefore, the proposed algorithm is an ideal candidate for sensor networks deployed in remote and inaccessible areas, which might need to change their objective once they have been set up.
Martino, Luca; Miguez, Joaquin
Generalized Rejection Sampling Schemes and Applications in Signal Processing Artículo de revista
En: Signal Processing, vol. 90, no 11, pp. 2981–2995, 2010.
Resumen | Enlaces | BibTeX | Etiquetas: Adaptive rejection sampling, Gibbs sampling, Monte Carlo integration, Rejection sampling, sensor networks, Target localization
@article{Martino2010a,
title = {Generalized Rejection Sampling Schemes and Applications in Signal Processing},
author = {Luca Martino and Joaquin Miguez},
url = {http://www.sciencedirect.com/science/article/pii/S0165168410001866},
year = {2010},
date = {2010-01-01},
journal = {Signal Processing},
volume = {90},
number = {11},
pages = {2981--2995},
abstract = {Bayesian methods and their implementations by means of sophisticated Monte Carlo techniques, such as Markov chain Monte Carlo (MCMC) and particle filters, have become very popular in signal processing over the last years. However, in many problems of practical interest these techniques demand procedures for sampling from probability distributions with non-standard forms, hence we are often brought back to the consideration of fundamental simulation algorithms, such as rejection sampling (RS). Unfortunately, the use of RS techniques demands the calculation of tight upper bounds for the ratio of the target probability density function (pdf) over the proposal density from which candidate samples are drawn. Except for the class of log-concave target pdf's, for which an efficient algorithm exists, there are no general methods to analytically determine this bound, which has to be derived from scratch for each specific case. In this paper, we introduce new schemes for (a) obtaining upper bounds for likelihood functions and (b) adaptively computing proposal densities that approximate the target pdf closely. The former class of methods provides the tools to easily sample from a posteriori probability distributions (that appear very often in signal processing problems) by drawing candidates from the prior distribution. However, they are even more useful when they are exploited to derive the generalized adaptive RS (GARS) algorithm introduced in the second part of the paper. The proposed GARS method yields a sequence of proposal densities that converge towards the target pdf and enable a very efficient sampling of a broad class of probability distributions, possibly with multiple modes and non-standard forms. We provide some simple numerical examples to illustrate the use of the proposed techniques, including an example of target localization using range measurements, often encountered in sensor network applications.},
keywords = {Adaptive rejection sampling, Gibbs sampling, Monte Carlo integration, Rejection sampling, sensor networks, Target localization},
pubstate = {published},
tppubtype = {article}
}
Bayesian methods and their implementations by means of sophisticated Monte Carlo techniques, such as Markov chain Monte Carlo (MCMC) and particle filters, have become very popular in signal processing over the last years. However, in many problems of practical interest these techniques demand procedures for sampling from probability distributions with non-standard forms, hence we are often brought back to the consideration of fundamental simulation algorithms, such as rejection sampling (RS). Unfortunately, the use of RS techniques demands the calculation of tight upper bounds for the ratio of the target probability density function (pdf) over the proposal density from which candidate samples are drawn. Except for the class of log-concave target pdf's, for which an efficient algorithm exists, there are no general methods to analytically determine this bound, which has to be derived from scratch for each specific case. In this paper, we introduce new schemes for (a) obtaining upper bounds for likelihood functions and (b) adaptively computing proposal densities that approximate the target pdf closely. The former class of methods provides the tools to easily sample from a posteriori probability distributions (that appear very often in signal processing problems) by drawing candidates from the prior distribution. However, they are even more useful when they are exploited to derive the generalized adaptive RS (GARS) algorithm introduced in the second part of the paper. The proposed GARS method yields a sequence of proposal densities that converge towards the target pdf and enable a very efficient sampling of a broad class of probability distributions, possibly with multiple modes and non-standard forms. We provide some simple numerical examples to illustrate the use of the proposed techniques, including an example of target localization using range measurements, often encountered in sensor network applications.
2009
Lazaro, Marcelino; Sanchez-Fernandez, Matilde; Artés-Rodríguez, Antonio
Optimal Sensor Selection in Binary Heterogeneous Sensor Networks Artículo de revista
En: IEEE Transactions on Signal Processing, vol. 57, no 4, pp. 1577–1587, 2009, ISSN: 1053-587X.
Resumen | Enlaces | BibTeX | Etiquetas: binary heterogeneous sensor networks, discrimination performance, Energy scaling, object detection, optimal sensor selection, performance-cost ratio, sensor networks, sensor selection, symmetric Kullback-Leibler divergence, target detection problem, Wireless Sensor Networks
@article{Lazaro2009bb,
title = {Optimal Sensor Selection in Binary Heterogeneous Sensor Networks},
author = {Marcelino Lazaro and Matilde Sanchez-Fernandez and Antonio Art\'{e}s-Rodr\'{i}guez},
url = {http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=4749309},
issn = {1053-587X},
year = {2009},
date = {2009-01-01},
journal = {IEEE Transactions on Signal Processing},
volume = {57},
number = {4},
pages = {1577--1587},
abstract = {We consider the problem of sensor selection in a heterogeneous sensor network when several types of binary sensors with different discrimination performance and costs are available. We want to analyze what is the optimal proportion of sensors of each class in a target detection problem when a total cost constraint is specified. We obtain the conditional distributions of the observations at the fusion center given the hypotheses, necessary to perform an optimal hypothesis test in this heterogeneous scenario. We characterize the performance of the tests by means of the symmetric Kullback-Leibler divergence, or J -divergence, applied to the conditional distributions under each hypothesis. By formulating the sensor selection as a constrained maximization problem, and showing the linearity of the J-divergence with the number of sensors of each class, we found that the optimal proportion of sensors is ldquowinner takes allrdquo like. The sensor class with the best performance/cost ratio is selected.},
keywords = {binary heterogeneous sensor networks, discrimination performance, Energy scaling, object detection, optimal sensor selection, performance-cost ratio, sensor networks, sensor selection, symmetric Kullback-Leibler divergence, target detection problem, Wireless Sensor Networks},
pubstate = {published},
tppubtype = {article}
}
We consider the problem of sensor selection in a heterogeneous sensor network when several types of binary sensors with different discrimination performance and costs are available. We want to analyze what is the optimal proportion of sensors of each class in a target detection problem when a total cost constraint is specified. We obtain the conditional distributions of the observations at the fusion center given the hypotheses, necessary to perform an optimal hypothesis test in this heterogeneous scenario. We characterize the performance of the tests by means of the symmetric Kullback-Leibler divergence, or J -divergence, applied to the conditional distributions under each hypothesis. By formulating the sensor selection as a constrained maximization problem, and showing the linearity of the J-divergence with the number of sensors of each class, we found that the optimal proportion of sensors is ldquowinner takes allrdquo like. The sensor class with the best performance/cost ratio is selected.