Joint learning under incomplete information and dynamic MU availability
Design an efficient and scalable solution that jointly addresses incomplete information at the mobile crowdsensing platform and at mobile units while accounting for dynamic mobile-unit availability in mobile crowdsensing-based sensing-as-a-service systems.
References
Although previous works have contributed significantly to task proposal and task assignment in \gls{mcs}, designing an efficient and scalable solution that jointly addresses incomplete information at the \gls{mcsp} and at the \glspl{mu}, while accounting for dynamic availability, remains an open problem.
Remark: Propositions~\ref{prop:etp_convergence} and~\ref{prop:tslta_convergence} characterize the fixed point each side converges to under stationarity of the other, because both sides learn simultaneously in practice, this is only approximately satisfied at finite $t$. The two updates operate on different effective timescales ($\tilde{U}{\mathrm{MCSP}_{k,z,t}$ updates once per assignment, while $Q(S_{k,t}, A_{k,t})$ updates once per MU decision), which is consistent with the two-timescale stochastic approximation framework of; we leave a full joint convergence proof to future work and instead provide extensive empirical evidence of stability in Sec.~V.