Sunday, June 1, 2008

Re: [HACKERS] Core team statement on replication in PostgreSQL

Hi Merlin,

My point here is that with reasonably small extensions to the core you can build products that are a lot better than SLONY.   Triggers do not cover DDL, among other issues, and it’s debatable whether they are the best way to implement quorum policies like Google’s semi-synchronous replication.  As I mentioned separately this topic deserves another thread which I promise to start.  

It is of course possible to meet some of these needs with an appropriate client interface to WAL shipping.  There’s no a-priori reason why built-in PostgreSQL slaves need to be the only client.  I would put a vote in for covering this possibility in the initial replication design.  We are using a very similar approach in our own master/slave replication product.  

Thanks, Robert

P.S., No offense intended to Jan Wieck et al.  There are some pretty cool things in SLONY.  

On 5/29/08 8:16 PM, "Merlin Moncure" <mmoncure@gmail.com> wrote:

On Thu, May 29, 2008 at 3:05 PM, Robert Hodges
<robert.hodges@continuent.com> wrote:
> Third, you can't stop with just this feature.  (This is the BUT part of the
> post.)  The use cases not covered by this feature area actually pretty
> large.  Here are a few that concern me:
>
> 1.) Partial replication.
> 2.) WAN replication.
> 3.) Bi-directional replication.  (Yes, this is evil but there are problems
> where it is indispensable.)
> 4.) Upgrade support.  Aside from database upgrade (how would this ever
> really work between versions?), it would not support zero-downtime app
> upgrades, which depend on bi-directional replication tricks.
> 5.) Heterogeneous replication.
> 6.) Finally, performance scaling using scale-out over large numbers of
> replicas.  I think it's possible to get tunnel vision on this—it's not a big
> requirement in the PG community because people don't use PG in the first
> place when they want to do this.  They use MySQL, which has very good
> replication for performance scaling, though it's rather weak for
> availability.

These type of things are what Slony is for.  Slony is trigger based.
This makes it more complex than log shipping style replication, but
provides lots of functionality.

wal shipping based replication is maybe the fastest possible
solution...you are already paying the overhead so it comes virtually
for free from the point of view of the master.

mysql replication is imo nearly worthless from backup standpoint.

merlin



--
Robert Hodges, CTO, Continuent, Inc.
Email:  robert.hodges@continuent.com
Mobile:  +1-510-501-3728  Skype:  hodgesrm

No comments: