Feb 1999 -
Academic Qualification  
B .Tech (Mechanical), Nagarjuna University 
M.Sc (Engineering), Dept. of Mechanical Engineeing, IISc 
CV Paper 1 Paper 2  
Research Interests  
Learning Algorithms  
email: raju@csa.iisc.ernet.in 
Work Experience
Project Associate in MEMH Lab, IIT Madras,1994-95
Current Work
Reinforcement Learning Algorithms and Applications in Dynamic Pricing of Retail Markets

My current research focuses on reinforcement learning (RL), and uses electronic commerce as a domain in which to explore the applicability of reinforcement learning algorithms. I am working on an actor-critic simulation based algorithm for the solution of infinite horizon Markov decision process with finite state and action spaces under the discounted cost criterion. The algorithm does gradient search in the space of randomized policies and uses simultaneous perturbation stochastic approximation (SPSA) type estimates. I combine the features of the two-time scale actor-critic algorithms and the gradient search based SPSA technique. I study RL applications in electronic commerce such as, how adaptive software agents may utilize RL algorithms to solve single agent and multi agent problems to make economic decisions such as setting prices in a competitive market place.

C. V. L. Raju and Y. Narahari, Queueing Network Modelling and Lead Time Compression of Electronic Procurement, International Conference on Robotics and Automation (ICRA 2002), Washington D.C., May 11-15, 2002.

Shantanu Biswas, C. V. L. Raju, and Y. Narahari, Iterative Reverse Dutch Auction for Procurement of Bundles, Submited to SIAM Conference on Optimization, Toronto, Canada, May 20-22, 2002.

C. V. L. Raju and Y. Narahari, Efficient eProcurement Auctions using Reinforcement Learning, International Conference on Energy, Automation and Information Technology (EAIT 2001), IIT Kharaghpur, December 10-12, 2001.

C. V. L. Raju and Y. Narahari, Effect of Internet Technologies on Performance of Procurement Process, Proceedings of 9th AIMTDR Conference, Indian Institute of Technology Madras, December 2000.

Contact Information
Contact Address 
Kaveri # 21, 

Phone: +91-80-309

Permanent Address 
s/o C. V. N. Raju,
56-6-7/3, Marithi Colony,
High School Road, Patamata,

Phone: +91-