Current Research

Optimization and Decision Making

I am interested in how make decision in complex domains especially when there are vary large state and action spaces. A wide range of optimization algorithms have been developed that are each appropriate in different types of problems. My policy gradient optimization algorithm for spatiotemporal domains, Equilibrium Policy Gradients utilizes a parametrized policy defined as the equilibrium distribution of a Markov chain built from local causal policies. I have used this algorithm to deal with the complexity caused by spatial structure common in computational sustainability domains. I also work on MDP planning algorithms with provable confidence intervals upon completion and other Reinforcement Learning approaches.

Graphical Models

Some of my work looks at modelling, inference and learning of interpretable probabilistic graphical models. I am particularly interested in cases where the underlying data is relational, such as social networks, or there is a need for both causal and correlational structure, cyclic structure in other words, within the same model. This arises naturally when trying to represent spatial policies using graphical models but cyclic structure can arise in many relational domains and existing fully directed or fully undirected models have trouble dealing with it.

Tree Learning

Other topics I am working on in Machine Learning include streaming decision tree learning for large datasets and scale invariant anomaly detection.

Computational Sustainability

The field of Computational Sustainability is at the intersection between computational sciences (such as artificial intelligence,  computational modelling, optimization and planning research) with applied research in environmental/ecological domains (such as land use management, invasive species spread, sustainable ecology management, smart grids and species tracking).

Some Past Papers

Here are some of the problems I am looking at and related papers:

Leave a comment

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: