inciter::ZalCG class

ZalCG Charm++ chare array used to advance PDEs in time with ZalCG.

Contents

Public static functions

static void registerReducers()
Configure Charm++ custom reduction types initiated from this chare array.

Constructors, destructors, conversion operators

ZalCG(CkMigrateMessage* m) explicit
Migrate constructor.

Public functions

auto ZalCG(const CProxy_Discretization& disc, const std::map<int, std::vector<std::size_t>>& bface, const std::map<int, std::vector<std::size_t>>& bnode, const std::vector<std::size_t>& triinpoel) -> ZalCG_SDAG_CODE explicit
Constructor.
void ResumeFromSync() override
Return from migration.
void setup(tk::real v)
Start setup for solution.
void advance(tk::real newdt)
Advance equations to next time step.
void feop()
Start (re-)computing domain and boundary integrals.
void comnorm(const std::unordered_map<int, std::unordered_map<std::size_t, std::array<tk::real, 4>>>& inbnd)
Receive contributions to boundary point normals on chare-boundaries.
void comrhs(const std::unordered_map<std::size_t, std::vector<tk::real>>& inrhs)
Receive contributions to right-hand side vector on chare-boundaries.
void comaec(const std::unordered_map<std::size_t, std::vector<tk::real>>& inaec)
Receive antidiffusive and low-order contributions on chare-boundaries.
void comalw(const std::unordered_map<std::size_t, std::vector<tk::real>>& inalw)
Receive allowed limits contributions on chare-boundaries.
void comlim(const std::unordered_map<std::size_t, std::vector<tk::real>>& inlim)
Receive limited antidiffusive contributions on chare-boundaries.
void evalres(const std::vector<tk::real>& l2res)
Evaluate residuals.
void comdea(std::size_t reactivate)
Communicate deactivation requests.
void deastat(int dea)
Receive aggregate deactivation status.
void comact(int ch, int deactivated)
Communicate deactivation status.
void resizePostAMR(const std::vector<std::size_t>& ginpoel, const tk::UnsMesh::Chunk& chunk, const tk::UnsMesh::Coords& coord, const std::unordered_map<std::size_t, tk::UnsMesh::Edge>& addedNodes, const std::unordered_map<std::size_t, std::size_t>& addedTets, const std::set<std::size_t>& removedNodes, const std::unordered_map<int, std::unordered_set<std::size_t>>& nodeCommMap, const std::map<int, std::vector<std::size_t>>& bface, const std::map<int, std::vector<std::size_t>>& bnode, const std::vector<std::size_t>& triinpoel)
Receive new mesh from Refiner.
auto solution() const -> const tk::Fields&
void integrals()
Compute integral quantities for output.
void step()
Evaluate whether to continue with next time step.
void evalLB(int nrestart)

Charm++ pack/unpack serializer member functions

CProxy_Discretization m_disc
Discretization proxy.
std::size_t m_nrhs
Counter for right-hand side vector nodes updated.
std::size_t m_nnorm
Counter for receiving boundary point normals.
std::size_t m_naec
Counter for receiving antidiffusive contributions.
std::size_t m_nalw
Counter for receiving allowed limits.
std::size_t m_nlim
Counter for receiving limited antidiffusive contributions.
std::size_t m_ndea
Counter for receiving deactivation requests.
std::size_t m_nact
Counter for receiving activation status communications.
int m_todeactivate
Flag: 1 if chare desires to deactivate.
int m_toreactivate
Flag: 1 if chare desires to reactivate.
int m_deactivated
Flag: 1 if chare is deactivated, 0 if active.
std::unordered_set<int> m_inactive
Deactived chares this chare communicates with.
std::map<int, std::vector<std::size_t>> m_bnode
Boundary node lists mapped to side set ids used in the input file.
std::map<int, std::vector<std::size_t>> m_bface
Boundary face lists mapped to side set ids used in the input file.
std::vector<std::size_t> m_triinpoel
Chare-boundary triangle face connecitivity.
tk::Fields m_u
Unknown/solution vector at mesh nodes.
tk::Fields m_p
Max/min antidiffusive edge contributions at mesh nodes.
std::unordered_map<std::size_t, std::vector<tk::real>> m_pc
tk::Fields m_q
Max/min allowed limits at mesh nodes.
std::unordered_map<std::size_t, std::vector<tk::real>> m_qc
tk::Fields m_a
Limited antidiffusive contributions at mesh nodes.
std::unordered_map<std::size_t, std::vector<tk::real>> m_ac
tk::Fields m_rhs
Right-hand side vector (for the high order system)
std::unordered_map<std::size_t, std::vector<tk::real>> m_rhsc
NodeDiagnostics m_diag
Diagnostics object.
std::unordered_map<int, std::unordered_map<std::size_t, std::array<tk::real, 4>>> m_bnorm
decltype(m_bnorm) m_bnormc
std::unordered_map<std::size_t, std::array<tk::real, 3>> m_bndpoinint
std::unordered_map<tk::UnsMesh::Edge, std::array<tk::real, 3>, tk::UnsMesh::Hash<2>, tk::UnsMesh::Eq<2>> m_bndedgeint
std::unordered_map<tk::UnsMesh::Edge, std::array<tk::real, 4>, tk::UnsMesh::Hash<2>, tk::UnsMesh::Eq<2>> m_domedgeint
Domain edge integrals.
std::vector<std::size_t> m_bpoin
Streamable boundary point local ids.
std::vector<tk::real> m_bpint
Streamable boundary point integrals.
std::array<std::vector<std::size_t>, 2> m_bsupedge
Superedge (face, edge) end points with local ids for boundary edges.
std::array<std::vector<tk::real>, 2> m_bsupint
Superedge (tet, face, edge) boundary edge integrals.
std::array<std::vector<std::size_t>, 3> m_dsupedge
Superedge (tet, face, edge) end points with local ids for domain edges.
std::array<std::vector<tk::real>, 3> m_dsupint
Superedge (tet, face, edge) domain edge integrals.
std::array<std::vector<tk::real>, 3> m_dsuplim
FCT limiter coefficients in domain superedges.
std::unordered_map<int, std::vector<std::tuple<tk::UnsMesh::Edge, tk::real>>> m_chbndedge
std::vector<std::uint8_t> m_besym
Streamable boundary point symmetry BC flags.
std::vector<tk::real> m_vol
Nodal volumes dynamically adjusted for deactivated chares.
std::vector<std::size_t> m_dirbcmasks
Nodes and their Dirichlet BC masks.
std::vector<std::size_t> m_prebcnodes
Nodes at pressure BCs.
std::vector<tk::real> m_prebcvals
Density and pressure values at pressure BCs.
std::set<std::size_t> m_symbcnodeset
Unique set of ordered nodes at which symmetry BCs are set.
std::vector<std::size_t> m_symbcnodes
Streamable nodes at which symmetry BCs are set.
std::vector<tk::real> m_symbcnorms
Streamable normals at nodes at which symmetry BCs are set.
std::set<std::size_t> m_farbcnodeset
Unique set of ordered nodes at which farfield BCs are set.
std::vector<std::size_t> m_farbcnodes
Streamable nodes at which farfield BCs are set.
std::vector<tk::real> m_farbcnorms
Streamable normals at nodes at which farfield BCs are set.
std::map<int, std::pair<std::vector<std::size_t>, std::vector<tk::real>>> m_surfint
Streamable surface integral nodes and normals * dA on surfaces.
std::vector<tk::real> m_dtp
Time step size for each mesh node.
std::vector<tk::real> m_tp
Physical time for each mesh node.
int m_finished
True in the last time step.
tk::real m_freezeflow
dt multiplier after flow no longer updated
int m_fctfreeze
Freeze FCT limiter if 1, 0 FCT as usual.
void pup(PUP::er& p) override
Pack/Unpack serialize member function.
void operator|(PUP::er& p, ZalCG& i)
Pack/Unpack serialize operator|.

Function documentation

static void inciter::ZalCG::registerReducers()

Configure Charm++ custom reduction types initiated from this chare array.

Since this is a [initnode] routine, the runtime system executes the routine exactly once on every logical node early on in the Charm++ init sequence. Must be static as it is called without an object. See also: Section "Initializations at Program Startup" at in the Charm++ manual http://charm.cs.illinois.edu/manuals/html/charm++/manual.html.

ZalCG_SDAG_CODE inciter::ZalCG::ZalCG(const CProxy_Discretization& disc, const std::map<int, std::vector<std::size_t>>& bface, const std::map<int, std::vector<std::size_t>>& bnode, const std::vector<std::size_t>& triinpoel) explicit

Constructor.

Parameters
disc in Discretization proxy
bface in Boundary-faces mapped to side sets used in the input file
bnode in Boundary-node lists mapped to side sets used in input file
triinpoel in Boundary-face connectivity where BCs set (global ids)

void inciter::ZalCG::ResumeFromSync() override

Return from migration.

This is called when load balancing (LB) completes. The presence of this function does not affect whether or not we block on LB.

void inciter::ZalCG::setup(tk::real v)

Start setup for solution.

Parameters
v in Total volume within user-specified box

void inciter::ZalCG::advance(tk::real newdt)

Advance equations to next time step.

Parameters
newdt in The smallest dt across the whole problem

void inciter::ZalCG::comnorm(const std::unordered_map<int, std::unordered_map<std::size_t, std::array<tk::real, 4>>>& inbnd)

Receive contributions to boundary point normals on chare-boundaries.

Parameters
inbnd in Incoming partial sums of boundary point normals

void inciter::ZalCG::comrhs(const std::unordered_map<std::size_t, std::vector<tk::real>>& inrhs)

Receive contributions to right-hand side vector on chare-boundaries.

Parameters
inrhs in Partial contributions of RHS to chare-boundary nodes. Key: global mesh node IDs, value: contributions for all scalar components.

void inciter::ZalCG::comaec(const std::unordered_map<std::size_t, std::vector<tk::real>>& inaec)

Receive antidiffusive and low-order contributions on chare-boundaries.

Parameters
inaec in Partial contributions of antidiffusive edge and low-order solution contributions on chare-boundary nodes. Key: global mesh node IDs, value: 0: antidiffusive contributions, 1: low-order solution.

void inciter::ZalCG::comalw(const std::unordered_map<std::size_t, std::vector<tk::real>>& inalw)

Receive allowed limits contributions on chare-boundaries.

Parameters
inalw in Partial contributions of allowed limits contributions on chare-boundary nodes. Key: global mesh node IDs, value: allowed limit contributions.

void inciter::ZalCG::comlim(const std::unordered_map<std::size_t, std::vector<tk::real>>& inlim)

Receive limited antidiffusive contributions on chare-boundaries.

Parameters
inlim in Partial contributions of limited contributions on chare-boundary nodes. Key: global mesh node IDs, value: limited contributions.

void inciter::ZalCG::evalres(const std::vector<tk::real>& l2res)

Evaluate residuals.

Parameters
l2res in L2-norms of the residual for each scalar component computed across the whole problem

void inciter::ZalCG::comdea(std::size_t reactivate)

Communicate deactivation requests.

Parameters
reactivate in 1 if sender wants to reactivate this chare, 0 if not

void inciter::ZalCG::deastat(int dea)

Receive aggregate deactivation status.

Parameters
dea in Sum of deactived chares

void inciter::ZalCG::comact(int ch, int deactivated)

Communicate deactivation status.

Parameters
ch in Sender chare id
deactivated in 1 if sender was deactivated, 0 if not

void inciter::ZalCG::resizePostAMR(const std::vector<std::size_t>& ginpoel, const tk::UnsMesh::Chunk& chunk, const tk::UnsMesh::Coords& coord, const std::unordered_map<std::size_t, tk::UnsMesh::Edge>& addedNodes, const std::unordered_map<std::size_t, std::size_t>& addedTets, const std::set<std::size_t>& removedNodes, const std::unordered_map<int, std::unordered_set<std::size_t>>& nodeCommMap, const std::map<int, std::vector<std::size_t>>& bface, const std::map<int, std::vector<std::size_t>>& bnode, const std::vector<std::size_t>& triinpoel)

Receive new mesh from Refiner.

Parameters
ginpoel in Mesh connectivity with global node ids
chunk in New mesh chunk (connectivity and global<->local id maps)
coord in New mesh node coordinates
addedNodes in Newly added mesh nodes and their parents (local ids)
addedTets in Newly added mesh cells and their parents (local ids)
removedNodes in Newly removed mesh node local ids
nodeCommMap in New node communication map
bface in Boundary-faces mapped to side set ids
bnode in Boundary-node lists mapped to side set ids
triinpoel in Boundary-face connectivity

const tk::Fields& inciter::ZalCG::solution() const

Returns Const-ref to current solution

Const-ref access to current solution

void inciter::ZalCG::evalLB(int nrestart)

Parameters
nrestart in Number of times restarted

void inciter::ZalCG::pup(PUP::er& p) override

Pack/Unpack serialize member function.

Parameters
p in/out Charm++'s PUP::er serializer object reference

void inciter::ZalCG::operator|(PUP::er& p, ZalCG& i)

Pack/Unpack serialize operator|.

Parameters
p in/out Charm++'s PUP::er serializer object reference
i in/out ZalCG object reference

Variable documentation

std::unordered_map<std::size_t, std::vector<tk::real>> inciter::ZalCG::m_pc

Receive buffer for max/min antidiffusive edge contributions

Key: global node id, value: max/min antidiff edge contributions

std::unordered_map<std::size_t, std::vector<tk::real>> inciter::ZalCG::m_qc

Receive buffer for max/min allowed limits

Key: global node id, value: max/min allowed limits in nodes.

std::unordered_map<std::size_t, std::vector<tk::real>> inciter::ZalCG::m_ac

Receive buffer for limited antidiffusive contributions

Key: global node id, value: limited antidiffusive contributions in nodes.

std::unordered_map<std::size_t, std::vector<tk::real>> inciter::ZalCG::m_rhsc

Receive buffer for communication of the right hand side

Key: global node id, value: rhs for all scalar components per node.

std::unordered_map<int, std::unordered_map<std::size_t, std::array<tk::real, 4>>> inciter::ZalCG::m_bnorm

Boundary point normals

Outer key: side set id. Inner key: global node id of boundary point, value: weighted normals, inverse distance square, nodal area.

decltype(m_bnorm) inciter::ZalCG::m_bnormc

Boundary point normals receive buffer

Outer key: side set id. Inner key: global node id of boundary point, value: weighted normals and inverse distance square.

std::unordered_map<std::size_t, std::array<tk::real, 3>> inciter::ZalCG::m_bndpoinint

Boundary point integrals

Key: global node id of boundary point, value: boundary point integral contributions.

std::unordered_map<tk::UnsMesh::Edge, std::array<tk::real, 3>, tk::UnsMesh::Hash<2>, tk::UnsMesh::Eq<2>> inciter::ZalCG::m_bndedgeint

Boundary edge integrals

Key: boundary edge-end points with global node ids, value: boundary edge integral contributions.

std::unordered_map<int, std::vector<std::tuple<tk::UnsMesh::Edge, tk::real>>> inciter::ZalCG::m_chbndedge

Chare-boundary edge end-points with difffusion integral

Key: neighbor chare id, value: domain-edge end-points and diffusion integral associated to the edge